The rational function analogue of a question of 
Schur and exceptionality of permutation 
representations 

Robert M. Guralnick * Peter Miiller t Jan Saxl * 
February 1, 2008 

Abstract 

In 1923 Schur considered the following problem. Let / £ Z[X] be a 
polynomial that induces a bijection on the residue fields Z/pZ for infinitely 
many primes p. His conjecture, that such polynomials are compositions 
of linear and Dickson polynomials, was proved by M. Fried in 1970. Here 
we investigate the analogous question for rational functions, and also we 
allow the base field to be any number field. As a result, there are many 
more rational functions for which the analogous property holds. The new 
infinite series come from rational isogenies or endomorphisms of elliptic 
curves. Besides them, there are finitely many sporadic examples which do 
not fit in any of the series we obtain. 

The Galois theoretic translation, based on Chebotarev's density theo- 
rem, leads to a certain property of permutation groups, called exception- 
ality. One can reduce to primitive exceptional groups. While it is impossi- 
ble to explicitly describe all primitive exceptional permutation groups, we 
provide certain reduction results, and obtain a classification in the almost 
simple case. 

The fact that these permutation groups arise as monodromy groups of 
covers of Riemann spheres / : P 1 — > P 1 , where / is the rational function 
we investigate, provides genus systems. These are generating systems 
of permutation groups with a certain combinatorial property. This condi- 
tion, combined with the classification and reduction results of exceptional 
permutation groups, eventually gives a precise geometric classification of 
possible candidates of rational functions which satisfy the arithmetic prop- 
erty from above. Up to this point, we make frequent use of the classifica- 
tion of the finite simple groups. 

We do not directly obtain information about the number fields over 
which these examples exist, or if they exist at all. However, except for 
finitely many cases, these remaining candidates are connected to isogenies 
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or endomorphisms of elliptic curves. Thus we use results about elliptic 
curves, modular curves, complex multiplication, and the techniques used 
in the inverse regular Galois problem to settle these finer arithmetic ques- 
tions. 



1 Introduction 



In 1923 Schur |Sch23| posed the following question. Let f{X) 6 7h\X\ be a 
polynomial which induces a bijection on Z/pZ for infinitely many primes p. He 
proved that if / has prime degree, then / is, up to linear changes over Q, a 
cyclic polynomial X k , or a Chebychev polynomial Tk(X) (defined implicitly by 
Tk(Z + 1/Z) = Z k + 1/Z k ). He conjectured that without the degree assumption, 
the polynomial is a composition of such polynomials. This was proved almost 



50 years later by Fried [ Fri7C ] 



The obvious extension of Schur's original question to rational functions over 
number fields then leads to the notion of arithmetical exceptionality as follows. 

Definition 1.1. Let K be a number field, and / £ K(X) be a non-constant 
rational function. Write / as a quotient of two relatively prime polynomials in 
.ftf[X]. For a place p of K denote by Kp the residue field. Except for finitely 
many places p, we can apply p to the coefficients of / to obtain f p g K p (X). 

Regard / p as a function from the projective line P 1 (if p ) = K p U{oo} to itself 
via x i — ► fp(x), with the usual rules to handle vanishing denominator or x = oo. 

We say that / is arithmetically exceptional if there are infinitely many places 
p of K such that / p is bijective on P 1 (K p ). 



A slight extension (see [ Tur95 |) of Fried's above result is the following. Here 
D m (a,X) denotes the Dickson polynomial of degree m belonging to a S K, 
which is most conveniently denned by D m (a, Z + a/Z) = Z m + (a/Z) m . 

Theorem 1.2 (Fried). Let K be a number field, and f € K[X) be an arith- 
metically exceptional polynomial. Then f is the composition of linear polynomi- 
als in K[X] and Dickson polynomials D m (a, X). 

In this paper we generalize Schur's question to rational functions over num- 
ber fields. Under the assumption that the degree is a prime, this has already 



been investigated by Fried |Fri78|, showing that there are non-polynomial ex- 
amples over suitable number fields. 

In contrast to the polynomial case, the classification result for rational func- 
tions is quite complicated — in terms of the associated monodromy groups as 
well as from the arithmetic point of view. It is immediate from the definition 
that if an arithmetically exceptional rational function is a composition of ratio- 
nal functions over K, then each of the composition factors is arithmetically ex- 
ceptional. Thus we are interested in indecomposable arithmetically exceptional 
functions. Note however that the composition of arithmetically exceptional 



functions need not be arithmetically exceptional, see Theorem 1.6 
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In order to state the classification of arithmetically exceptional functions, 
we need to introduce some notation. Let K be a field of characteristic 0, and 
/ £ K(X) be a non-constant rational function. Write / = R/S with coprime 
polynomials R, S £ K[X]. Then the degree deg(/) of / is defined to be the 
maximum of deg(i?) and deg(S'). Note that deg(/) is also the degree of the field 
extension K(X)\K(f(X)). 

Let t be a transcendental over K, and denote by L a splitting field of R(X) — 
tS(X) over K(t). Let K be the algebraic closure of K in L, and set A = 
Gal(L\K(t)), G = Gal(L\K(t)). Throughout the paper, A and G are called the 
arithmetic and geometric monodromy group of /, respectively. Note that G is 
a normal subgroup of A, with A/G = G&\(K\K). Furthermore, A and G act 
transitively on the roots of R(X) — tS(X). 

Let K be an algebraic closure oi K, pi, . . . , p r be the places of K(t) which 
ramify in KL, and let e% be the ramification index of ^Pi|pj, where ^ is a place 
of KL lying above pi. The unordered tuple (ei, . . . , e r ) is a natural invariant 
associated to /, we call it the ramification type of /. Denote by K m i n a minimal 
(with respect to inclusion) field, such that / exists over K — K m i n with given 
geometric monodromy group G and given ramification type. Of course the field 
K m in need not be unique, but it turns out that in most cases in the theorem 
below, it is. 

If we fix G and the ramification type, then there are usually several possi- 
bilities for A, and one can also ask for a minimal field of definition if one fixes 
A too. To keep the theorem below reasonably short, we have not included that. 
Results can be found in the sections where the corresponding cases are dealt 
with. 

A rough distinction between the various classes of indecomposable arith- 
metically exceptional functions is the genus g of L. Note that (see also Section 
g, equation @) 

2(|G|-l+. 9 ) = |G|5>-l/ e ,). (1) 

The cases g — and g — 1 belong to certain well-understood series, to be 
investigated in Sections || and q, respectively. If g > 1, then / belongs to one 
of finitely many possibilities (finite in terms of G and ramification type). These 
sporadic cases are investigated in Section ^. 

Definition 1.3. Let K be a field, and f(X) £ K(X) be a rational function. 
Then we say that / is equivalent to h(X) £ K(X), if / and h differ only by 
composition with linear fractional functions over K. (Of course, the arithmetic 
and geometric monodromy group is preserved under this equivalence, and so is 
the property of being arithmetically exceptional.) 

The rough classification of indecomposable arithmetically exceptional ratio- 



nal functions is given in the following theorem. See Section 3.1 for notation, 
and Sections ||, [|, and ^ for more details. 

Theorem 1.4. Let K be a number field, f £ K{X) be an indecomposable arith- 
metically exceptional function of degree n > 1, G the geometric monodromy 
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group of f , T — (ei, . . . , e r ) i/ie ramification type, and K m i n be a minimal field 
of definition as defined above. Let g be as defined in equation (Q) . 

(a) If g = 0, then either 

(i) n > 3 is a prime, G = C n , T = (n, n), K m in = Q; or 

(ii) n > 5 is a prime, G = C n x C2, T = (2, 2, n), K m in = Q; or 
fm; n = 4,G = C 2 xC 2 ,T= (2, 2, 2), X min = Q. 

In case (i), f is equivalent to X n or to a Redei function, in case (ii), f 
is equivalent to a Dickson polynomial (see Section^). 

(b) If g = 1, then n = p or p 2 for an odd prime p. In the former case set 
N = C p , and N = C p x C p in the latter case. Then one of the following 
holds. 



(i) 


n>b,G = Ny\ G 2 , T = (2, 2, 2, 2). K min = Q ij 
or n e {5, 7, 11, 13, 17, 19, 37, 43, 67, 163}; or 


~ and only if n 


= p 2 


(ii) 


n = 1 (mod 6), G = N x C e , T = (2, 3, 6), K mm 
Kmin = Q(\/— 3) ifn = p; or 


= Q ifn = p 2 , 


and 


(Hi) 


n = 1 (mod 6), G = N x C 3 , T = (3, 3, 3), K min 
Kmm = Q(V-3) ifn = p; or 


= Q if n = p 2 , 


and 


(iv) 


n = 1 (mod 4), G = N x C A , T = (2, 4, 4), if mm 

i^min = Q(V-T) if n = p. 


= Qifn =p 2 , 


and 



The functions f arise from isogenics or endomorphisms of elliptic curves 
as described in Section \a. 



(c) If g > 1, then 

(1) n = ll 2 , G = C 2 n xGL 2 (3), T = (2,3,8), g = 122, K mm = Q(>/=2); 
or 

n = 5 2 , G = C 2 x S 3 , T = (2, 3, 10), g = 6, K mm = Q; or 

(m) n = 5 2 , G — C 2 ys H with H a Sylow 2-subgroup of the subgroup of 
index 2 GL 2 (5), T = (2, 2, 2, 4), g = 51, if roin = Q(v^T); or 

ft«; n = 5 2 , G = C| x (C 6 x C 2 ) 7 T = (2, 2, 2, 3), g = 26, K mm = Q; or 

(v) n = 3 2 , G = Cf x (G 4 x G 2 ), T = (2,2,2,4), 5 = 10 or T = 
(2, 2, 2, 2, 2), 5 = 19, and K m in = Q in both cases; or 

(vi) n = 28, G = PSL 2 (8), T = (2,3,7), g = 7, T = (2,3,9), .9 = 15, or 
T = (2, 2, 2, 3), g = 43, and if m j n — Q in all three cases; or 

(vii) n = 45,G = PSL 2 (9), T = (2, 4, 5), g = 10, and K mm = Q. 

The main part of the proof is group theoretic. Arithmetic exceptionality 
translates equivalently to a property of finite permutation groups, see Section |[ 
Let A and G be finite groups acting transitively on fi; with G a normal subgroup 
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of A. Then the triple (A, G, ft) is said to be exceptional if the diagonal of il x SI 
is the only common orbit of A and G. We do not completely classify such triples 
- we may return to this in a future paper. Instead, we use further properties 
coming from the arithmetic context. Namely we get a group B with G < B < A 
with B/G cyclic such that (J3,G,f2) is still exceptional. We say that the pair 
(A, G) is arithmetically exceptional if such a group B exists. 

The notion of exceptionality has arisen in different context. It typically 
comes in the following situation: Let K be a field, and cf> : X — * Y be a 
separable branched cover of projective curves which are absolutely irreducible 
over K . Let A and G denote the arithmetic and geometric monodromy group 
of this cover, respectively. Then (A, G) is exceptional if and only if the diagonal 
is the only absolutely irreducible component of the fiber product X X. The 
arithmetic relevance lies in the well known fact that an irreducible, but not 
absolutely irreducible curve, has only finitely many rational points. Thus if the 
fiber product has the exceptionality property, then there are only finitely many 
P,Q € X(K) with P 7^ Q and <j){P) = 4>(Q), so <j> is essentially injective on ir- 
rational points. If K has a procyclic Galois group, for instance if K is a finite 
field, then A/G is cyclic, and exceptionality automatically implies arithmetic 
exceptionality. 

For these reasons we have considered it worth the effort to obtain reasonably 
complete reduction or classification results for (arithmetically) exceptional per- 
mutation groups. For our original question about the analog of Schur's question, 
we could have used the genus condition on G (see Section ^) at earlier stages 
to remove many groups from consideration before studying exceptionality. 

A special case of exceptionality has arisen recently in some work on graphs 
(see [GLPS] and LP]). The question there involves investigating those excep- 
tional groups in which the quotient A/G is cyclic of prime order. 

If G < A are transitive permutation groups on n points, with U < A the 
stabilizer of a point, then A is primitive if and only if U is a maximal subgroup 
of A. Suppose that A is imprimitive, so there is a group M with U < M < A. 
If (A, G) is arithmetically exceptional, then so are the pairs (M, MnG) (in the 
action on M/U) and (A, G) in the action on A /M . The converse need not hold 
(but it holds if A/G is cyclic, see Lemma |3.5[ ). 

Thus our main focus is on primitive permutation groups. We use the Aschbacher- 
O 'Nan-Scott classification of primitive groups, which divides the primitive per- 
mutation groups into five classes (cf. Section ^2). The investigation of these 
five classes requires quite different arguments. Exceptionality arises quite often 
in affine permutation groups, one cannot expect to obtain a reasonable classifi- 
cation result. 

Let (A, G) be arithmetically exceptional, and A primitive but not affine. 
We show that A does not have a regular nonabelian normal subgroup, which 
completely removes one of the five types of the Aschbacher-0 'Nan-Scott clas- 
sification. If A preserves a product structure (that means A is a subgroup of 
a wreath product in product action), then we can reduce to the almost simple 
case. If A/G is cyclic, does not preserve a product structure, but acts in di- 
agonal action, then we essentially classify the possibilities (up to the question 
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of existence of outer automorphisms of simple groups with a certain technical 
condition). So the main case to investigate is the almost simple action. We 
obtain the following classification, where all the listed cases indeed do give ex- 
amples. All these examples are groups of Lie type. There are many possibilities 
if the Lie rank is one. For higher Lie rank, the stablizers are suitable subfield 
subgroups. 

Theorem 1.5. Let Abe a primitive permutation group of almost simple type, so 
L < A < Aut(L) with L a simple nonabelian group. Suppose there are subgroups 
B and G of A with G < A and B/G cyclic, such that (B, G) is exceptional. Let 
M be a point stabilizer in A. Then L is of Lie type, and one of the following 
holds. 

(a) L = PSL 2 (2 a ), G = L and either 

(i) M n L = PSL 2 (2 b ) with 3 < a/b = r a prime and B/G generated by 
a field automorphism x such that Cl{x) is not divisible by r; or 

(ii) a > 1 is odd and M n G is dihedral of order 2{q + 1). 

(b) L = PSL 2 (<?) with q = p a odd, G = L or PGL 2 (<?) and either 

(i) Mf)L — PSL 2 (p b ) with r := a/b prime and r not a divisor of p{p 2 — 1) , 
and B any subgroup containing an automorphism x which is either a 
field automorphism of order e or the product of a field automorphism 
of order e and a diagonal automorphism, such that r does not divide 

p 2a/e _ 1; Qr 

(ii) MC\L = L 2 (p a/p ) and B is a subgroup o/Aut(G) such that p\[B : G] 
and B contains a diagonal automorphism; or 

(Hi) a is even, M n L is the dihedral group of order p a — 1 and B/G is 
generated by a field- diagonal automorphism; or 

(iv) p — 3, a is odd, M n L is dihedral of order p a + 1 and B = Aut(G). 

(c) L = Sz(2 a ) with a > 1 odd, and M n L = Sz{2 a / b ) with b a prime not 5 
and a ^ b or M (~l L is the normalizer of a Sylow ^-subgroup (which is the 
normalizer of a torus ); or 

(d) L = i?e(3 a ) with a > 1 odd and M D L = i?e(3 a/fc ) with b a divisor of a 
other than 3 or 7; or 

(e) L — Uz{p a ) and L fl M = Uz{p a / h ) with b a prime not dividing p(p 2 — 1); 
or 

(f) L = C/3(2 a ) with a > 1 odd and MC\L is the subgroup preserving a subspace 
decomposition into the direct sum of 3 orthogonal nonsingular 1- spaces; or 

(g) L has Lie rank > 2, L ^ Sp 4 (2)' (= PSL 2 (9), a case covered in [b]). Then 
M n L is a subfield group, the centralizer in L of a field automorphism of 
odd prime order r. Moreover, 
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(i) r^p, 

(ii) ifr = 3, then L is of type Sp 4 with q even, and 
(Hi) there are no Aut(L)- stable L-conjugacy classes of r- elements. 

If we now consider the primitive arithmetically exceptional groups which are 
not affine and add the genus condition on G, then only two gro ups s urvive, 
accounting for the non-prime-power degrees 28 and 45 in Theorem |l.4| . 

In the affine case, we first use the genus condition (except for noting that 
exceptionality implies that G is not doubly transitive), and then check which 
ones give arithmetically exceptional configurations. We end up with six infinite 
series (and a few sporadics). Two of the series are well known and correspond 
to Redei functions and Dickson polynomials, respectively. The other four series 
have an interesting connection with elliptic curves, to be investigated in Section 
|[ Section [?] takes care of the sporadic cases. There we will also see that there 
is a big variety of arithmetically exceptional functions of degree 4 over number 
fields. This will have the following surprising consequence. 

Theorem 1.6. Let K be an arbitrary number field. There are four arithmeti- 
cally exceptional rational functions of degree 4 over K , such that their compo- 
sition is not arithmetically exceptional. 
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2 Arithmetic— geometric preparation 



2.1 Arithmetic and geometric monodromy groups 

Let if be a field of characteristic and t be a transcendental. Fix a regular 
extension E of K it) of degree n. (Regular means that K is algebraically closed 
in E.) Denote by L a Galois closure of E\K(t). Then A := Ga\(L\K(t)) is called 
the arithmetic monodromy group of E\K(t), where we regard A as a permutation 
group acting transitively on the n conjugates of a primitive element of E\K(t). 

Denote by K the algebraic closure of K in L. Then G := Gal(L\K(t)) is 
called the geometric monodromy group of E\K(t). Note that A/G = Gal(K\K), 
and that G still permutes the n conjugates of E transitively, as E and K(t) are 
linearly disjoint over K(t). 

If f(X) G K(X) is a non-constant rational function, then we use the terms 
arithmetic and geometric monodromy group for the extension E = K(x) over 
K(t), where a; is a solution of f(X) — t in some algebraic closure of K(t). In 
this case, we call K the field of constants of /. 



2.2 Distinguished conjugacy classes of inertia generators 

We continue to use the above notation. Let K be an algebraic closure of K. We 
identify the places p : t ^ b (or 1 / 1 1 — >• if 6 = oo) of K(t) with K U {oo}. Let 
p be a ramified place of L\K(t). Set y := t — p (or y := 1/t if p = oo). There 
is a minimal integer e such that L embeds into the power series field K({y^ e )). 
For such an embedding let a be the restriction to L of the automorphism of 
KHy 1 ^)) which is the identity on the coefficients and maps y x l e to (y 1 ^, where 
£ is a primitive eth root of unity. The embedding of L is unique only up 
to a A'(t)-automorphism of KL, that is a is unique only up to conjugacy in 
G = Ged(L\K(t)) = Gal(KL\K(t)). We call the G-conjugacy class C of a the 
distinguished conjugacy class associated to p. Note that each a in C is the 
generator of an inertia group of a place of L lying above p, and that e is the 
ramification index of p. 

Let the tuple B := (pi, ... , p r ) consist of the places of Kit) which are ramified 
in KL, and let % = {C\, . . . ,C r ) be the tuple of the associated distinguished 
conjugacy classes of G. We call the pair (23, 7i) the ramification structure of 
L\K(t). 



2.3 Branch cycle descriptions 

A fundamental fact, following from Riemann's existence theorem and a topo- 
logical interpretation of the geometric monodromy group as described below is 



the following. See [V6196 for a selfcontained proof. 



Proposition 2.1. With the notation from above, let pi, . . . ,p r be the places of 
Kit) which ramify in L, and letCi be the distinguished conjugacy class associated 
to pi. Then there are <Ji € Ci, such that the Oi generate G, and the product 
relation g\<J2 ■ ■ ■ cr r = 1 holds. 
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We call such a tuple (a%, . . . , oy) a branch cycle description of L\K(t). 

The branch cycle description allows us to compute the genus of the field 
E. First note that this genus is the same as the genus of KE. For a € G, let 
ind(cr) be [E : K(t)\ minus the number of cycles of a in the given permutation 
representation. Then the Riemann-Hurwitz genus formula yields 

ind(o-i) = 2([E : K{t)\ - 1 + genus(£)). (2) 

i 

If the genus of E from above is 0, then we also call (cti, . . . , ay) a genus 
system. 



Riemann's existence theorem, see [Vbl96| 



A sort of converse to Proposition 2.1 is the following algebraic version of 



Proposition 2.2. Let K be an algebraically closed field of characteristic 0, 
<7i, . . . , ay be a generating system of a finite group G with o~\(Ti . . . ay = 1, and 
pi, .. .,p r distinct elements from K U {oo}. Then there exists a Galois exten- 
sion L\K(t) with group G, ramified only in pi, ... , p r , such that the distinguished 
conjugacy class associated with pi is the conjugacy class af. 

2.4 The branch cycle argument 

We have seen that we can realize any given ramification structure over K(t). A 
situation we will encounter frequently is whether we can get a regular extension 
E\K(t) with given ramification structure, and given pair (G, A) of geometric and 
arithmetic monodromy group. A powerful tool to either exclude possible pairs, 
or to determine A if G is known, is provided by Fried's branch cycle argument 



(see [V5196, Lemma 2.8], [MM99, Section 1.2.3], [Shi74, Part 1]), of which the 



following proposition is an immmediate consequence. 

Proposition 2.3. Let K be a field of characteristic 0, L\K(t) be a finite Ga- 
lois extension with group A, K the algebraic closure of K in L, and G := 
G&l(L\K(t)). Let (B,Ti) be the ramification structure of L\K(t) . Let („ be a 
primitive n-th root of unity, where n = \G\. Let 7 e Gal(-R^l-R') —: T be arbi- 
trary, and m with with 7 _1 (Cn) = CT • Let a € A be the restriction to L of an 
extension of 7 to Gdl(KL\K(t)). Then B is T-invariant and C 7 ( p ) = (C™) a for 
each p e B. 

Often, we will use the following special case. 

Corollary 2.4. Let L|Q(i) be a finite Galois extension with group A, Q the 
algebraic closure of Q in L, and G := Gal(X|(Q)(t)). Let p be a rational place of 
(Jit), and a be in the associated distinguished conjugacy class of G. Then for 
each m prime to the order of a, the element o~ m is conjugate in A to a. 

Often the branch cycle argument does not help in excluding certain pairs 
(A, G) and given ramification structure. Then the following observation is some- 
times helpful. 
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Lemma 2.5. Let K be a field of characteristic 0, t a transcendental, and L\K{t) 
be a finite Galois extension with group A. Let K be the algebraic closure of K in 
L, and set G = Gal(L\K(tj). Let p be a rational place of K(t), and ^ be a place 
of L lying above p. Denote by D and I the decomposition and inertia group of 
*P, respectively. Then L < D n G and A = GD. In particular, A = CNa(I)- 

Proof. Without loss assume that p is a finite place, so K[t] is contained in 
the valuation ring. Let Oi be the integra l closu re of K[t] in L. Then D/I is 
the Galois group of (Oi/qS)\(K[t]/p), see |Ser79| , Chapter I, §7, Prop. 20]. On 



the other hand, K embeds into Oi/ty, so D/I surjects naturally to A/G = 
Gal(K\K). Furthermore, if <fi £ I, then u — £ *}3 for all u £ K, hence tj> is 
trivial on K, so I < D n G. □ 

2.5 Weak rigidity 

We use the weak rigidity criterion in order to prove existence of certain regular 
extensions E\K(t) with given ramification structure and geometric monodromy 
group. The main reference of the material in this section is MM99| and [ Vol96 |. 



Definition 2.6. Let G be a finite group, and Ti = (C\,C2, ■ ■ ■ ,C r ) be an r- 
tuple of conjugacy classes of G. Consider the set of r-tuples (01,0-2, ■ ■ ■ ,°v) 
with Oi £ Ci which generate G and ct\02 ■ ■ ■ <J r = 1. We say that H is weakly 
rigid if this set is not empty, and if any two r-tuples in this set are conjugate 
under Aut(G). 

Definition 2.7. Let K be a subfield of C, and 8c^U be an unordered 
tuple of distinct elements. Associate to each p € B a conjugacy class C p of a finite 
group G of order n, and let 7i be the tuple of these classes. Set T := Gal(K\K), 
and let be a primitive n-th root of unity. For each 7 S T let 771(7) be an 
integer with 7~ 1 (C«) = Cr?'' 7 ''- 

(a) The pair {B, TL) is called K-rational, if B is T-invariant and C 7 ( p ) = 
for each 7 £ T and p £ B. 

(b) The pair (B, TL) is called weakly K-rational, if B is T-invariant and C 7 ( P ) = 

a(C p Tl( ' 7 ' ) ) for each 7 £ T and p £ B, where a £ Aut(G) depends on 7, but 
not on p. 

Proposition 2.8. Let K be afield of characteristic 0, G be a finite group which 
is generated by <7i,...,o> with a\G2---o r = 1. Let B = {pi,p2, . . . ,p r } C 
¥ 1 (K), and let C Pi be the conjugacy class of at. Suppose that 

Ti := {Cp 1 , . . . , Cp r ) 

is weakly rigid and 

(B,H) 
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is weakly if -rational. 

Furthermore, let H < G be a subgroup which is self-normalizing and whose 
G-conjugacy class is Aut(G) -invariant. Suppose that one of the pi is rational, 
and that C Pi intersects H non-trivially for this index i. Also, suppose that the 
(Tj are a genus system with respect to the action on G/H. 

Then there exists f G K(X) with geometric monodromy group G acting on 
G/H and ramification structure (B,Ti). 



Proof. By Proposition 2.2, there exists a Galois extension L\K(t) with group 



G and ramification structure (B,7i). Weak rigidity implies that L is Galois 



over K(t), see e.g. JVol96| , Remark 3.9(a)]. Set A := Gal(L|if (*)), so G is the 
fixed group of K(t). Let J be the normalizer of H in A. As G is transitive 
on the ^-conjugates of H we obtain A — GJ. Also, G n J — H because H is 
self-normalizing in G. Let E be the fixed field of J in L. Then E is linearly 
disjoint from K(t) over K(t), and KE is the fixed field of H . By assumption, E 
has genus 0, and the hypothesis about the nontrivial intersection of some class 
C Pi with H with pi being if -rational implies E has a if -rational place, thus is 



a rational field K(x), e.g. by |Sti93, 1.6.3]. Write t = f(x) with / £ K(X), then 



/ is the desired function. □ 



Definition 2.9. Let C be a conjugacy class of G, n the order of G, and £ n a 
primitive root of unity. For 7 an automorphism of Q let m be with j(Cn) = C™ 1 - 
Then the class C is said to be If -rational if C m = C for each 7 S Gal(Q|if). 
This property is well known to be equivalent to x(C) € if for all irreducible 
characters % °f C. In particular, if the character values of the classes in H as 
above are in K, and B C K, then (S, H) is if -rational. 



2.6 Topological interpretation 

Though we do not really need it here, it might help understanding some ar- 
guments in this paper if one also has the geometric interpretation of a branch 
cycle description in mind. 

Suppose that if is a subfield of the complex numbers C. As C(t) n L — K(t) 



(see ]Che51| , Corollary 2, V, §4]), we get Gal(CL|C(t)) S Gal(L|if(i)) by re- 
striction. For any holomorphic covering a : A — > B of Riemann surfaces, denote 
by a* : A4(B) <—* Ai(A) the natural inclusion of the fields of meromorphic func- 
tions on B and A. Associated to CE|C(t) is a branched, holomorphic covering 
7r : S — > P 1 (C) of degree n = [i? : if (t)] with 5 a connected Riemann surface 
and P X (C) the Riemann sphere, such that the extension A4(5)|vr*(A4(P 1 (C))) 
can be identified with CE\C(t). Observe that M(P X (C)) ^ C(i). 

Let B = {pi,p 2 , ■ ■ ■ j Pr} be the set of branch points of tt. Fix p € P 1 (C)\S, 
and denote by the fundamental group 7Ti(P 1 (C) \ B,po). Then Q acts tran- 
sitively on the points of the fiber 7r _1 (po) by lifting of paths. Fix a numbering 
1,2,... , n of this fiber. Thus we get a homomorphism Q — * S n of C? into the 
symmetric group S n . By standard arguments, the image of Q can be identified 
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with the geometric monodromy group G defined above, thus we write G for this 
group too. 

This identification has a combinatorial consequence. Choose a standard 
homotopy basis of P 1 (C) \ B as follows. Let 7* be represented by paths which 
wind once around pi clockwise, and around no other branch point, such that 
7172 • • • 7r = 1- Then 71, 72, ■ ■ • , 7r-i freely generate Q. 




Let <7i be the image of 7$ in G. It can be shown that this construction is 



compatible with the algebraic definition of th e conjugacy classes Ci (see V6196 
Section 1.5.4]), thus proving Proposition 



2.7 Group theoretic translation of arithmetic exception- 
ality 

Here we provide the setup for the equivalent translation of arithmetic excep- 
tionality in terms of monodromy groups. The material in this section is well 
known (mainly in the context of polynomials, with immediate generalization to 
rational functions). Let K be a. number field, and f(X) G K(X) of positive 
degree. 

With t a transcendental, let L be a splitting field of f(X) — t over K(t), and 
K be the algebraic closure of K in L. Set A := Gal(L\K(t)) — the arithmetic 
monodromy group of / — and G :— Gal(L\K (t)) — the geometric monodromy 
group. Recall that A/G = G&\(K\K). We regard A and its subgroups as 
permutation groups on the set VI of the roots of f{X) — t. If B is a group 
between A and G, then we say that the pair (_B, G) is exceptional if the diagonal 
of n x fl is the only common orbit of B and G. 



Theorem 2.10 (Fried, [Ffi78|). In the setup from above the following holds. 



(a) f is arithmetically exceptional if and only if there is a group B with G < 
B < A with B/G cyclic such that (B,G) is exceptional. 
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(b) There is a constant C £ N depending on f with the following property. 
Let p be a place of K with \K V \ > C. Then f p is defined, and f p is 
bijective on P 1 (K p ) if and only if (B,G) is exceptional, where B/G is the 
decomposition group of a place of K lying above p . 

Proof. There is a constant C' such that for \K p \ > C 1 the following holds. 
The place p is unramified in K, f p is defined, and f P {X) — t is separable. Let 
A p and G P be the arithmetic and geometric monodromy group of f p over K p 
respectively. 

Let B be the subgroup of A such that B /G induces the decomposition group 
of a place of K lying above p. Then, if C' was big enough, we have the following 



result by Fried [Fri74, Lemma 1] 



A P ^B 
G p — G. 



Furthermore, it is known (see |FGS93|) that there is a bound C" such that if 



\Kp\ > C", then f p is bijective on F 1 (K P ) if and only if (A p ,G p ) is exceptional. 
This proves (b) and the 'only if part of (a). 

To prove the 'if part of (a), assume that there is B as in (a). Let bG generate 
A/G. By Chebotarev's density theorem there are infinitely many primes p of K 
with a prime *}3 of K above, such that bG induces the Frobenius automorphism 
on Krp\K p . In particular, B then is the decomposition group of *}3, and the 
assertion follows from (b). □ 



2.8 Remark about exceptional functions over finite fields 

Let F q be a finite field with q elements, where q is a power of the prime p. Let 
f(X) £ ¥ q (X) be a rational function which is not the p-th power of another 
rational function. We say that / is exceptional if / is bijective on F 1 (¥ q m) 
for infinitely many m £ N. Let A and G be the arithmetic and geometric 
monodromy group of /. Then A/G is cyclic, and / is exceptional if and only if 
(A, G) is exceptional with respect to the action on the roots of f{X) — t, this 
follows from proof of Theorem [2.10[ 

In [FGS93] the possible monodromy groups of exceptional polynomials have 
been classified, and the question about existence of actual examples has been 
answered positively for all non-affine groups in |CM94|, [LZ96 , and for some 
affine groups in [GM97|. 



Indeed, aside from the affine examples, all indecomposable exceptional poly- 
nomials are now known (sec [GZ] and GRZOlQ. This can be extended to 
arbitrary fields using [GS01|. 



We hope to eventually achieve a similar result for exceptional rational func- 



tions over finite fields. Our result Theorem 1.5 shows that the key ingredient is 



to prove that the generic example of exceptionality cannot be of genus (i.e. the 
case where G is a Chevalley group and the action is on the cosets of a subfield 
group). 
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If all the ramification of ¥ q (X)\¥ q (f(X)) is tame (that is all the inertia 
groups have order not divisible by p) , then we get the exact analogue of Proposi- 
tion 2.1 by Grothendieck's existence theorem, see [Gro71, XIII, Corollary 2.12]. 
As a result, we obtain the same group-theoretic candidates. Of course, the 
question about actual existence, which used various arithmetic arguments and 
results applicable for the rationals or number fields, is quite different and will 
not be pursued in this paper. 



3 Group theoretic exceptionality 
3.1 Notation and definitions 

Here we gather definitions and notation from finite group theory which are 
used throughout this paper. Notation used only locally is defined where it first 
appears. 

General notation: For a, b elements of a group H set a b := b^ab. Fur- 
thermore, if A and B are subsets of H , then A b , a B and A B have their 
obvious meaning. If G is a subgroup of H, then for a subset S of H let 
Cq(S) denote the centralizer of S in G and Ng(5) denote the normalizer 
{g e G\ S 9 = S} of S in G. 

If A, B, . . . is a collection of subsets or elements of H, then we denote by 
<A, B, . . .> the group generated by these sets and elements. 

Let 7r be a set of primes. A 7r-group is a group with order only divisible 
by primes in n. Denote P \ ir by tt' . The subgroup 0„(H) of H is the 
maximal normal 7r-subgroup. If 7r consists of a single prime p, then we 
write Op rather than Ou,y. 

Permutation groups: Let G be a permutation group on a finite set fi. We use 
the exponential notation to 9 to denote the image of u> € Q under g £ G. 
The stabilizer of uj in G is denoted by G w . If G is transitive on fl, then 
the action of G on S] is isomorphic to the coset action of G on G/G u , the 
set of right cosets of G^ in G. 

Let x(q) be the number of fixed points of g on f2, and ind(g) the index, 
which is I ill minus the number of orbits of <uj>, see Section |2.6l 



Specific groups: We denote by C n and D n the cyclic and dihedral group of 
order n. The alternating and symmetric group on n letters is denoted 
by A n and S n respectively (also if we view it as an abstract rather than 



permutation group). We will generally follow the notation used in [ At85 
for the almost simple groups. 

Exceptionality: Let G be a normal subgroup of A, with both A and G being 
transitive permutation groups on the finite set il. Then (A, G, ft) is called 
exceptional if the diagonal of f2 x f2 is the only common orbit of A and G 
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on Q x O. This definition is equivalent to the following: Let w6(l, then 
every ^4^-orbit except {lu} breaks up into strictly smaller G w -orbits. 

Motivated by Theorem p.lOj , we call the triple (A, G, Q) arithmetically 
exceptional, if there is a subgroup B of A which contains G, such that 
(B, G, f2) is exceptional, and B/G is cyclic. 



3.2 Primitive groups 

Recall that if J is a finite group, then F(J) is the Fitting subgroup of J, the 
maximal normal nilpotent subgroup of J. We denote the maximal normal p- 
subgroup of J by O p ( J). A subgroup H is subnormal (written H « J) if there 
is a composition series for J with H as a term. A group is called quasisimple if 
it is perfect (i.e. its own commutator subgroup) and simple modulo its center. 
A component of J is a quasisimple subnormal subgroup. Any two distinct 
components commute and any component commutes with F(J). The central 
product of all the components is denoted by E(J). The generalized Fitting 
subgroup is F*(J) :— E(J)F(J). An important property is that F*(J) contains 
its own centralizer (and so J/Z(F*(J)) embeds in Aut(F*(J))). 

We say J is almost simple if F*(J) is a nonabelian simple subgroup. Note 
that this is equi valent t o L C J C AutjX) for L nonabelian simple (and so 
L = P*(J)). See [|Asc86| , flHup67| , or |5uz82H for more details on these concepts. 



We use the Aschbacher-O'Nan-Scott classification of primitive groups (cf. 



[AS85|, |LPS88|). Let A be a group acting primitively and faithfully on f2. Let 
M be a point stabilizer and set E — F*(A). We have to consider the following 
cases (there are other ways of dividing up the possibilities): 

(AfF) E is an elementary abelian p-group, A — ME (semidirect), M acts 
irreducibly on E and E acts regularly on A/M. 

(Reg) A contains a regular normal nonabelian subgroup. 

(AS) A is almost simple. 

(Prod) E = L\ x ■ • • x L t with t > 1 and Li = L a nonabelian simple group. 
Moreover, the Li are conjugate in A and E n M — Ji x • • ■ x J t where 
J t = M HL,. 

(Diag) E = L\ X • • • X Lt with t > 1 and Lj = L a nonabelian simple group. 
Moreover, the Li are conjugate in A and E n M is a product of diagonal 
subgroups of E. 



3.3 General results on exceptionality 

We begin with some general properties of exceptionality which do not require a 
finer analysis of various classes of groups. 

The following result is straightforward and well known. 
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Lemma 3.1. Let G act transitively on a finite set Q. If H is a point stabilizer 
and g € G, then 

m 

X (g) = X^CcGfc) : C H ( 9i )}, 

i=l 

where gi, . . . , g m is a set of representatives for the H-conjugacy classes of g C\H . 
Proof. 

X(g) = \C G (g)\\g G nH\/\H\ = \C G (g)\ £| 5 f \/\H\ = £[C G (<fc) : C H ( 9l )}. 

□ 

The next two results are essentially in ]FGS93| , 13.1]. See also [ pW97| Sec- 
tion 3]. 

Lemma 3.2. Let A be a finite group with G a normal subgroup with A/G cyclic 
generated by xG. Suppose A acts on a finite set Q. Then X^eG^^s) = r \G\, 
where r is the number of common orbits that A and G have on tt. 

In particular, if A and G are both transitive on Q, then the sum above is 
|G|, i.e. the average number of fixed points of an element is 1. An immediate 
consequence is: 

Lemma 3.3. Let G be a normal subgroup of the finite group A with A/G cyclic 
generated by xG. Let SI be a transitive A-set. Assume that G is also transitive 
on SI. The following are equivalent: 

(i) (A, G, SI) is exceptional; 

(ii) x{ x 9) - 1 f or oil 9 £ G; 

(Hi) x( x g) = 1 f or a U 9 € G; 

(iv) x{ x 9) > 1 f or °H 9 ^ G. 

Let M be a subgroup of A. Note that G is transitive on A/M if and only if 
A = MG. If in addition A/G is cyclic then this is equivalent to the existence 
of x £ M with A/G generated by xG. 

Lemma 3.4. Assume that (A,G, A/M) is exceptional and that xG is a gener- 
ator of A/G with x G M. 

(a) Ca(x) and N^4(<a;>) have a unique fixed point on A/M (and therefore 
are contained in M); 

(b) If g € A and gxg~~ Y € M, then g e M; 

(c) Let Mq = N J 4(<x>) and define Mj+x inductively by Mj+i = {g G A : 
gxg~ 1 G Mi}. Then Mi C M for each i. 
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Proof. By Lemma |3.3| and exceptionality, x has a unique fixed point, whence 
(a) holds. Let g £ A with gxg^ 1 £ M. So g fixes the unique fixed point of x, 
thus g £ M. Claim (c) follows from (b). □ 

The following is well known and easy. 

Lemma 3.5. Let G be a normal subgroup of A with A/G cyclic. Suppose 
M < U < A and A = GM. Then (A, G, A/M) is exceptional if and only if 
(A, G, A/U) and (U, GDU, U/M) are exceptional. 

Proof. Choose a generator xG for A/G with x £ M. Suppose (A,G, A/U) is 
not exceptional. Then some element xg has no fixed points on A/U and so has 
none on A/M, whence (A,G, A/M) is not exceptional. 

So we may assume that (A,G, A/U) is exceptional. Then each xg has a 
unique fixed point on A/U. So xg is conjugate to some y £ U. The number of 
fixed points of y on A/M is precisely the number of fixed points on U/M; the 
claim follows. □ 

The next results provide methods for producing exceptional triples. 

Suppose A/G is cyclic of order e. Note that we may always choose a gener- 
ator xG for A/G such that the order of x divides a power of e (by replacing x 
by a power of itself) and necessarily that e divides the order of x. 

Before stating the next theorem, we make the following easy observation - 
if G is a finite group and x is an automorphism of G, then Cc(xg) is a 7r'-group 
for all g £ G if and only if x preserves no G-conjugacy class of 7r-elements in G. 

Theorem 3.6. Let G be a normal subgroup of the finite group A with A/G 
generated by xG. Let ir be a set of primes, and write x = yz = zy where y is a 
■k -element and z is a it 1 -element. Assume that Co(xg) is a it' -group for every 
g£ Cc(y). Then (A, G, A/Ca{v)) * s exceptional. 

Proof. Set M = Ca(u)- Note that G is transitive on A/M, since x £ M. It 
suffices to prove that xg has at most 1 fixed point on A/M for each g £ G. We 
may assume that xg has at least one fixed point and so we may take g £ M 
(note that x £ M). Write xg — y'z' — z'y 1 where y' is a 7r-element and z' 
is a Tr'-element in M. Note that y £ CA(xg) (since g £ M) and yG = y'G 
(as the decomposition into commuting n— and 7r'-elements is unique). But the 
7r-element yy' 1 commutes with xg, so is also a 7r'-element by assumption, thus 
y = y 1 . We contend that any A-conjugate of xg which is contained in M is an 
M-conjugate. So assume that (xg) a £ M, where we may assume a £ G as 
A = CA(xg)G. So (xg) a = xg with g = a~ x ga £ Cg(u)- As above, it follows 
that the 7r-part of xg is y. Thus a £ Ca{u) = M, proving our claim. □ 

Corollary 3.7. Let G be a normal subgroup of the finite group A with A/G 
generated by xG. Let H be a subgroup of G normalized by x. Let M — <H,x>. 
If the order of x is relatively prime to |Cg(x)|, then {A,G, A/M) is exceptional 
if and only if Cq(x) C M. 
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Proof. The condition Cq{x) C M is necessary by Lemma 3.4(a). 

We show that even (A,G, A/Ca{x)) is exceptional, the claim then follows 
from Lemma |3.5[ Since the order of x is prime to |Cg(x)|, it follows that 
Cc(xg) Q Cc(x) for every g £ Cq(x): if c~ 1 xgc — xg then c xc — x by 
the uniqueness of the decomposition of xg into commuting k— and 7r'-elements. 
Thus, we may apply the previous result with y = x. □ 



The next two lemmas show that exceptionality descends in certain cases and 
will allow us to use induction in analyzing this property. 

Lemma 3.8. Let G be a normal subgroup of A with A/G generated by xG. Let 
M be a subgroup of A with (A,G, A/M) exceptional. If Ai is a subgroup of A 
such that x € Ai n M , then (Ax, G n Ax, Ax/(M R Ax)) is exceptional. 

Proof. Note that A = GA 1 as x G Ax. We get A x = G<x> n A x = (G n 
Ai)<x> C (Gfl A\){Ax l~l M), soGnii is transitive on A X /(M n Ax). Since 
xg € xG for every g £ G Ci Ax, xg has at most one fixed point on Ax/(M fl Ax). 
By Lemma |3.3| this implies that (Ax , G D Ax, Ax/ (M PI Ax)) is exceptional. □ 



Lemma 3.9. Let G be a normal subgroup of A with A/G generated by xG with 
Q a transitive A-set. Let L be a nontrivial normal subgroup of A contained in 
G such that L is transitive on Q (e.g. this is so if A is primitive on fl). Then 
(A, G, Q) exceptional implies that (B,L,D,) is exceptional where B = <L,x>. 

Proof. Every element in the coset xL has a unique fixed point on fl. □ 

We make two more useful observations. 

Lemma 3.10. Let G be a normal subgroup of A with A/G generated by xG. 
Assume that (A,G, A/M) is exceptional and that x G M. Let b be a power of 
the prime r. Then [Ca(v) ■ Cm(v)] = 1 (mod r) for y = x b . 

Proof. Let u> £ A/M be the fixed point of x. Consider the orbit of Ca(v) 
containing to. Of course, x acts on this orbit and y acts trivially. So x acts on 
this orbit as an r-element. The size of this orbit is [Ca(u) ■ Cjf(j/)]. Since x 
has a unique fixed point uj on this orbit, the assertion follows. □ 



Lemma 3.11. Assume that (A, G, A/M) is exceptional and A/G is a power of 
the prime p. Then [A : M] = 1 (mod p). 

Proof. Let H = MnG. Then [M : H] = [A : G], a power of p. Also, M/H fixes 
no iJ-orbits other than {M}, by exceptionality. The assertion follows. □ 
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3.4 Examples of exceptionality 

We use Corollary |3.7| to provide some examples of exceptional triples. 

Example 3.12. Let G = L* with t > 1 and L a finite group. Let x be the 
automorphism of G of order t which cyclically permutes the coordinates of G. 
Let D = Cg(x) (the diagonal of G). Let A be the semidirect product of G 
and <x>. Set M = <D,x>. Then (A, G, A/M) is exceptional if and only if 
(t,|£|) = l. 



Proof. If t is relatively prime to \L\, this follows by Corollary 3.7. If £ is not 
relatively prime to \L\, we can choose 1 ^ ft e L with ft* = 1. It follows that 



and x are conjugate in A but not in M for g = (ft, ... , ft). Lemma 3.1 implies 



that x has more than 1 fixed point. □ 
In fact, one can modify the previous example. 

Example 3.13. Let G — L 1 with t prime and L a finite group. Let u be the 
automorphism of G of order t which cyclically permutes the coordinates of G. 
Suppose that v is an automorphism of L of order prime to t such that v preserves 
no conjugacy class of elements of order t in L. Let x — (v,... ,v)u £ Aut(G). 
Let D = C G (u) (the diagonal of G). Let A = <G, x>. Set M = <D, x>. Then 
(A,G, A/M) is exceptional. 

Proof. Note that x preserves no conjugacy class of £-elements in G (if it did, 
there would be t classes of L permuted by v, whence each fixed by v, contra- 



dicting the hypotheses). Now apply Theorem 3.6 with u = y and 7r = {t}. □ 



Example 3.14. Let x be the field automorphism of the simple Chevalley group 
G := L(q a ) determined by the g-th power map on the field of q a elements. If 
a > 1 and (a, |Cg(^)|) = 1, then (A, G, A/M) is exceptional for A the semidirect 
product of G and <x> and M any subgroup of A containing 0,4(2:) which is 
normalized by x. 

The typical case for M n G above is the normalizer of L(q b ) in G for some 
b\a (and if we consider primitive actions a/b prime). For example, if G = L2(p a ) 
with a odd and x is the Frobenius automorphism, then we get examples as long 
as (a,p(p 2 — 1)) = 1 and a > 1. 

The next example is an elaboration of the previous one and gives almost all 
examples of exceptionality for almost simple groups. 

Theorem 3.15. Let G = X(q) be a finite simple Chevalley group defined over 
the field F q with q — p a . Let x be a field or graph-field automorphism of G. Let 
r be a prime different from p such that (x) contains a field automorphism of 
order r and assume that one of the following conditions hold: 

• there are no x-invariant G-conjugacy classes of elements of order r in G; 
or 
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• Cx(x) contains no elements of order r, where X is the corresponding 
algebraic group. 

Let A = <G,x> and M — Ga{v), where y is an element of order r in (x) (so 
M is a subfield group). Then (A,G, A/M) is exceptional. 

Proof. Note that the existence of an x-invariant class is equivalent to the fact 
that r divides \Cc{xg)\ for some jeG. Since Cx(xg) is conjugate to Cx(x) 
(by Lang's theorem), the second condition above implies the first. 

So r does not divide the order of Ca(xg) for any g € G. Now apply Theorem 
.6} □ 

Since one knows the outer automorphism groups of Chevalley groups quite 



explicitly (see |GLS98|), it is easy to determine when there exists an invariant 



class of r-elements. 

Lemma 3.16. Let G be a finite simple Chevalley group of characteristic p. Let 
r be a prime. Assume that there does not exist a conjugacy class of G consisting 
of elements of order r that is Aut(G) -invariant. 

(i) There exists an automorphism of G that fixes no conjugacy class of r- 
elements; 

(li) r^2, and r = 3 if and only if G = L 2 (3 a ), Sp 4 (2 a ) or Sz(2 a ); 
(in) r — p if and only if G = £2(9) with q odd; 

(iv) if G is untwisted and has no graph automorphisms, then such a class exists 
if and only if r divides the order of the corresponding group over the prime 
field; 

(v) for the other groups, the set of r for which there exists an Aut (G) -invariant 
class of r-elements are precisely those primes r which divide i(G), with 



i(G) given in Table 3.4, page\2. 



Proof. The fact that r^2 follows by ||FGS93|]. If r = p, this follows easily 
by induction: If L is rank 1 or 2, the result is clear. In general, choose a Levi 
subgroup whose class is Aut(G)-invariant and apply induction. 

So assume that r/j). Thus, r-elements are semisimple and so all r-classes 
are invariant under inner-diagonal automorphisms (because any such element is 
contained in a maximal torus of Inndiag(G)). 

Thus, we need only work modulo inner-diagonal automorphisms. The com- 
plete set of primes r for which there is an Aut(G)-invariant class of r-elements 
comes from inspection and Lang's Theorem. In the table, we give a subgroup of 
G that is centralized by a subgroup of Aut(G) which induce all automorphisms 
and so certainly all such r have the property. Conversely, by considering field 
and graph-field automorphisms (and extending to the algebraic group and using 
Lang's theorem), we see that if there exists an invariant class of r-elements, then 
r does divide the order of the group given. 
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Table 1 : r- invariant classes for r =/= p 



G 


i(G) 


Jj (r> a \ II (n a \ n odd 


1(9 (n)\ 

1 \P) | 


L n (p a ),U n (p a ),n>2even 


|PSp„(p)| 


Sp 4 (2 a ),Sz(2 a ) 


\Sz{2)\ 


G 2 (T), 2 G 2 (T) 


| 2 G 2 (3)| 


F 4 (2 a ), 2 F 4 (2 a ) 


| 2 ^ 4 (2)| 


0+(p a ), 3 D A (p a ) 


\G2(P)\ 


o 8 (p a ) 


|0 7 (p)| 


0^ m (p a ),m>4 


|Oam-i(p)| 


E 6 (p a ), 2 E 6 (p a ) 


I^(P)| 



Finally, we prove (i). Assume that there are no r-invariant classes under 
Aut(G). If the automorphism group modulo the inner-diagonal automorphisms 
is cyclic, the result is clear. In the remaining cases which are the untwisted 
groups of type A n , n > 1, B 2 or F4 (in characteristic 2), D n and Eg, one checks 
from the table that for any given r, one of a field or graph-field automorphism 
fixes no r-class. □ 

There are some other examples for rank 1 groups. In particular, we mention 
some interesting examples for L 2 (some of these come up in the classification of 



exceptional polynomials |FGS93|). 

The next examples give rise to interesting families of exceptional polynomi- 
als. 

Example 3.17. Let L — L 2 (2 a ) with x a field automorphism of odd order 
a > 1. Set A — (L,x) and M the normalizer of a nonsplit torus of L. Then 
(A, L, A/M) is exceptional. 

Proof. We can identify A/M with set of subgroups of order 3 in L. It suffices 
to show that every element y in the coset xL has at most one fixed point. Since 
A/L has odd order, we may take y to be of odd order and so we need show that 
y centralizes at most one subgroup of order 3 in L. By Lang's Theorem y and 
x and conjugate over the algebraic group and have centralizer PGL2(2) = S3, 
whence the result. □ 



Example 3.18. Let L = L 2 (3 a ) with a > 1 odd. Let x be the field-diagonal 
automorphism of order 2a. Set A — (L,x) and M the normalizer of a nonsplit 
torus of L. Then (A, L, A/M) is exceptional. 
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Proof. We can identify A/M with the set of involutions of L. Note that for 
any g £ L, C := C^(xg) contains no unipotent elements. By Lang's theorem, 
the centralizer of xg in the algebraic group is PGL2(3). If xg centralizes no 
involution, then C — 1 (since it contains no unipotent elements). Then x and 
xg are conjugate in A, whence Ci,(x) ~ 1. On the other hand, x acts as an 
involution on PSL2(3) and so has a nontrivial centralizer. See also Proposition 



3.22. □ 



Example 3.19. Let L = L 2 (p a ) with p > 2 and a even. Let x be the product 
of the diagonal automorphism and any field automorphism of even order. Set 
A = (L,x) and M the normalizer of a split torus of L. Then (A, L, A/M) is 
exceptional. 

Proof. We can identify A/M with the set of involutions of L. Note that for 
any g £ L, C := C^{xg) contains no unipotent elements. By Lang's theorem, 
the centralizer of xg in the algebraic group is PGL2(p & ) where a/b is even. In 
particular, C is isomorphic to a subgroup of PGL 2 (p & ). 

Suppose that C has odd order. Then C is cyclic and contained in a split 
torus of L (since its order divides p 2b — 1). Thus there exists a unique central 
involution in Cl(C) (since a is even). It follows that xg centralizes this involu- 
tion, whence C cannot have odd order. Thus, xg has at least one fixed point, 
whence exceptionality holds. □ 



Example 3.20. Let G = VH where V is a finite dimensional vector space over 
the field ¥ q of q elements and H is a group of F q -automorphisms of V. Let 
1 ^ r be a divisor of q — 1 with H containing no element of order r. Choose an 
element x £ GL(V) of order r acting as a scalar on V. Set M = H x <x> and 
A = VM. Then (A, G, A/M) is exceptional. 

The next example is an exceptional triple where A/G is not cyclic. There 
are minor variations on the theme by taking products of simple groups. 

Example 3.21. Let G be a nonabelian simple group. Let A = G x H with 
H ^ G. Let M be the diagonal subgroup of A. Then (A, G x 1,A/M) is 
exceptional. Moreover, if G = A$, then (G,A/M) = (G,G) may correspond to 
a covering of genus (with inertia groups of order 2, 3 and 5). 



3.5 Nonabelian regular normal subgroups 



The following result is an immediate consequence of |FGS93, Lemma 12.1]. It 
was observed with another proof in a later paper of Rowley |Row95|. 



Proposition 3.22. Let G be a finite group and x £ Aut(G) with Cg(x) 
Then G is solvable. 



1. 



Proof. Take a counterexample with \G\ minimal. Let A be the semidirect prod- 
uct G x <x>. The hypothesis is equivalent to Gx is a single conjugacy class 
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in A. This hypothesis persists on x-invariant sections of G. So we may assume 
that G is characteristically simple. By ]FGS93 , 12.1], there exists an involution 
t in G with t G = t A . Thus, A = GC A (t) and so gx G C A (t) for some g S G, 
so Cc(gx) is nontrivial. Since x is conjugate to gx, also Cg(^) is nontrivial, a 
contradiction. □ 



Lemma 3.23. Let G be a nontrivial normal subgroup of the finite group A 
acting primitively and faithfully on CI. Suppose (B,G) is exceptional, with G < 
B < A, and B /G cyclic. Then A does not contain a regular normal nonabelian 
subgroup. 

Proof. As A is primitive, then every nontrivial normal subgroup acts transi- 
tively. Suppose N is a regular normal subgroup of A. As G is normal in A, a 
minimal normal subgroup of A contained in G is either N or centralizes AT, so 
is regular in cither case. Thus we may assume that G contains N. Let M be 
the stabilizer in A of a point in Ct. Then N is a set of coset representatives of 
M in A. As Mnm — Mn m for n S N,m G M, we may identify the action of M 
on fl with the conjugation action of M on AT. In particular, if x G M, then we 
may identify the fixed points of x in £1 with C jy (x) . Since N is a direct product 
of nonabelian simple subgroups, it follows by the previous result that Cn(x) is 
nontrivial for any automorphism x of N. In particular, no element of A has a 
unique fixed point (either it fixes no points or fixes at least 2 points), contrary 
to exceptionality. □ 



3.6 Product action 

Lemma 3.24. Suppose E := F*(A) = L\ x • • • x L t with Li a non-abelian 
group, t > 1, and with the set of Li being the complete set of A— conjugates of 
L\. Let M be a maximal subgroup of A such that M fl E = R± x • • • x Rt where 
Ri = M n Li 7^ 1. Let G be a normal subgroup of A with A = GM . 

Suppose (A,G, A/M) is (arithmetically) exceptional. Then (Ax, L\, Ai/Mi) 
is (arithmetically) exceptional for some group A\ with F*(A±) — L\, M\ maxi- 
mal in A\ and R\ = M\ n L\. 

Proof. Set X — A/M. Since E is transitive, we may assume that E — G. There 
is no harm in enlarging A to the maximal subgroup of Aut(i5) which still acts 
on A/M (namely, we may assume that A — EN where N is the normalizer of 
M in Aut(.E)). Then A = A x I S t where F*(A 1 ) = L x and M = Mi I S t where 
Mi is a maximal subgroup of A±. Let A4 be a conjugate of A\ via <?; G M 
which maps L\ to Li. Since gi 6 M , Ri — Rf. Let Mi — M n Ai (which is the 
gi-conjugate of Mi). We may identify A/M with A1/M1 x • • • x A t /M t . Set 
Xi = Ai/Mi. 

First assume that the hypothesis of exceptionality holds and suppose (Ai, L\, A\/M\) 
is not exceptional. Then M\ and R\ have a nontrivial common orbit Y\ on X\. 
Let Yi the corresponding orbit in Xi. Note that St permutes these orbits and so 
Y = Yi X • • • X Yt is an M-orbit. By construction, it is also an Mfli?-orbit. Thus, 
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it is a nontrivial common M, M n G-orbit, contradicting the exceptionality of 
(A,G,A/M). This proves the claim. 

Now assume the hypothesis of arithmetic exceptionality holds and keep nota- 
tion as above. Thus there is a group B with G < B < A, such that (B, G, A/M) 
is exceptional and B/G is cyclic. Let xE be a generator for B/E. Suppose that 
y = x d is the smallest power of x which normalizes L\ (note that this depends 
only on the coset xE and not on x). We can then view y as acting on A\jM\. 
We claim that every element of yL\ has a unique fixed point on A\jM\. It 
suffices to assume that x is transitive on the set of Li (if not, consider a sin- 
gle a;-orbit and note that the number of fixed points of x on Z\ x Z<i is just 
the product of the number of fixed points - so for every such decomposition 
preserved by x, it will have a unique fixed point on both Z\ and Z 2 ). 

Then, by conjugating we may assume that x = s(y, 1, . . . ,1) where s G St- 
The number of fixed points of x is precisely the same as the number of fixed 
points of y on X\. Since xg has a unique fixed point for each g £ E, it follows 
that if g € L±, then x = s(yg, 1, . . . ,1) has a unique fixed point, whence yg does 
as well. This proves the claim. □ 

3.7 Diagonal action 

As we have seen above, the product action case can be reduced to a smaller 
case, so in considering the diagonal case, the essential situation is where a point 
stabilizer is a full diagonal subgroup. 

Theorem 3.25. Suppose A acts primitively and faithfully on and is of di- 
agonal type but does not preserve a product structure on ft. Suppose that G is 
normal in A and A/G is cyclic. If (A, G, Cl) is exceptional, then the following 
hold: 

• F*(A) is the direct product oft copies of a nonabelian simple group L; 

• G normalizes each component of A; 

• t is a prime and there exists an automorphism v of L such that v preserves 
no conjugacy class of elements of order t and Cj,{vg) = Ci((»j) i ) for all 
g € L (in particular, this is the case if t does not divide \L\ taking v = 1 
or if v is a t' -element preserving no t-class). 

If all the conditions above hold, then there exists a corresponding exceptional 
triple (A, G,n). 

Proof. Assume that (A, G, 0) is exceptional. Let M be the normalizcr in A 
of the standard diagonal. Since A does not preserve a product structure on 
f2, it follows that a point stabilizer of E := F*(A) is a full diagonal subgroup 
which we may identify with the standard diagonal subgroup. Moreover, A acts 
primitively on the set of components. Suppose that G does not act trivially on 
the set of components. Then G is transitive on the set of components and there 
exists x £ A generating A/G with x normalizing a component L. Since L acts 
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scmiregularly on Q and Cl(x) 7^ 1, there is a regular L-orbit containing the 
fixed point of x. The set of x-fixed points on this orbit can be identified with 
Cl{x), a contradiction. 

Thus, A/G is a primitive cyclic group on the set of t components, whence t 
is prime. Let u be the automorphism of E cyclically permuting the components 
of L. So we may assume that x = u(v,... ,v) where v £ Aut(i) (since x 
normalizes the diagonal subgroup of E). 

Since x normalizes no other diagonal subgroup, it follows that Ca(x) < M. 
Let g\ <G Ci(w*). Then define gi, i = 2, . . . , t by 

di+ivgl 1 = v, 

for i = 1, . . . , t\. It follows that (gi,.. . ,gt) commutes with x. Thus, gi — g\ 
for all i, whence g\ commutes with v. Thus, Cl(v) = C^(v l ) as claimed. 

Applying the same argument to vg yields the fact that Ci(ug) = Cl^vc/)') 
for all g <G G. 

Conversely, we now show that the triple (A, G, A/M) is exceptional. We will 
show that every element xg for g <G G has at least one fixed point, whence the 
result holds. 

So consider y := x(gi, . . . , gt) — u{vg\ 1 . . . , vg t ). We need to show that this 
is conjugate to z :— u(vh, . . . , vh) for some h e L. Note if we take t-th powers 
we see that vg t ■ ■ ■ vgi must be conjugate to (vh) 1 . 

Let J = (L,v). We first show that there exists h £ H such that vg t ■ ■ ■ vgi — 
(vhy. Consider the mapping va \— > (va) 1 for a e L. If (va)* = v*, then 
va e Cj(j)*) = Cj(v). Thus, Cj(v) = V x V where V is the Sylow t-subgroup 
of (v) and V is a i'-group (this follows from the fact that v fixes no t-class of 
L and that Cj(v) = C,/(u t )). Clearly, the t-th power map is injective on vV. 
Thus, (va)* — v l implies that a = 1. Since vg has the same property as v for 
any g G L, the same argument shows that the t-th power map is injective on vL. 
Thus, the image of the t power on vL is precisely v t L. So choose h satisfying 
the equation above. 

We now show that y and z are conjugate (for this choice of h). Choose 
Si, . . . ,s t <G L satisfying 

S2Wffisr 1 = s 3 vg 2 Sz 1 = ... s t vgt-is~\ = vh, 

with si = 1. 

Note that each Si is uniquely determined. 
Multiplying and telescoping we see that 

(vhy- 1 = s t vg t -i ■ ■■vgiSi 1 . 

We now compute that 

sivgtSt 1 =Si(w/i)*(u5t-i---«5i)" 1 sr 1 = (vhfivh) 1 -* = vh. 

A straightforward computation shows that conjugating u(vg\,... ,vg t ) by 
(si, . . . , s t ) gives u(vh, ... ,vh). 

Thus every element in the coset xG has at least one fixed point as claimed. 

□ 
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One can show that any automorphism v of a simple group satisfying the 
conditions above must have order prime to t (and so the example is already 



given in Example 3.13). The only proof that we can see is by inspection using 
the classification. 



By [FGS93], it follows that t > 2 and moreover t may be taken to be 3 if 
and only if L = Sz(q), £2(3°) or Sp4(q) with q even. One can use this result 
to give an alternative proof of the nonexistence of exceptional triples of genus 
zero of diagonal type in the next section. 

3.8 Almost simple groups 

In this section, we consider the exceptionality of triples (A, G, A/M) in the case 
where F*(A) is a non-abelian simple group L. We essentially classify all such 
arithmetically exceptional examples. 

We first assume that L = L^ijf) with p prime and p a > 3. The examples 



include the important examples discovered in [FGS93| with p = 2 or 3, a > 1 



odd, A — Aut(i) and M the normalizer of a nonsplit torus. These lead to 



inter e sting fam ilies of exceptional polynomials (see [Mul94|, [CM94], [LZ96|, 



G^l, fGRZOlj ) 



Theorem 3.26. Let G = £2(2") with a > 1 odd. Let H be a proper subgroup 
ofG. The following are equivalent: 

(i) There exist subgroups M and A of Aut(G) with G < A such that A = GM 
and G n M = H with (A, G, A/M) exceptional; 

(li) L 2 (2) C H and (3, [G : H}) = 1; 

(Hi) H contains a dihedral subgroup of G of order 2 • 3 b where 3 b is the order 
of a Sylow 3- subgroup of G. 

Proof. Assume (i). Let x € Aut(G) = PrL(2,2 a ) denote the Frobenius auto- 
morphism generating the full group of field automorphisms. Let y be a power 
of x with yG a generator for A/G. It follows by Lemma |3.4| that Ca(x) C M . 
Suppose that 3 divides the index [G : H\. Let T be a Sylow 3-subgroup of 
H . Let S be the (unique) Sylow 3-subgroup of G properly containing T. Then 
S is cyclic. By the Frattini argument, we may choose yg normalizing T, with 
g £ H. We may replace yg by (yg) 2 and assume that yg has odd order (since a 
is odd, (yg) 2 G still generates A/G). Since the normalizers of S and T coincide, 
it follows that yg normalizes S. Since yg has odd order, this implies that yg 



centralizes S±/T, where [Si : T] = 3. By Lemma 3.4, this implies that Si C H, 
a contradiction. Thus (i) implies (ii). 

Assume (ii). Then H contains a Sylow 3-subgroup of G and an involution 
inverting an element of order 3. This implies that H contains the dihedral group 
claimed in (iii). 

Assume (iii). Let D denote this dihedral group. Note that any subgroup 
H of G containing D is normalized by a conjugate of the field automorphism 
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generating the full group of field automorphisms. Thus, we may assume that 
A = Aut(G). 

Replacing D by a conjugate, we may assume that x normalizes D. Let 
J = <D, x>. It suffices to show that A/ J is exceptional. Let H be the unique 
normalizer of a nonsplit torus in G, containing D. Let M = <H,x>. It is 
straightforward to check that (M, H, M/ J) is exceptional (e.g., pass to M := 
M / coreM_(J) and observe that this group is a Frobenius group), whence by 
Lemma |3.5| it suffices to show that (A, G, A/M) is exceptional. 

We can identify A/M with the set of subgroups of order 3 in G (since M is 
the normalizer of a subgroup of order 3 and any two such are conjugate in G). 
It suffices to show that xg for g 6 M has at most one fixed point on A/ J. We 
may square this element to assume that xg has odd order. The fixed points of 
xg are the subgroups of order 3 centralized by xg. By Lang's Theorem, xg is 
conjugate (in the algebraic group) to x, whence its centralizer (in the algebraic 
group) is £2(2). So it centralizes at most one subgroup of order 3 as desired. □ 



Theorem 3.27. Let G = £2(2°) with a even. Let H be a proper subgroup of 
G. There exist subgroups M < A < Aut(G) = PrL 2 (2 Q ) with A = GM and 
M n G = H with (A, G, A/M) exceptional if and only if H — L2(2 b ) where 
(6,o/ft) = l. 

Proof. Let x denote a generator for the full group of field automorphisms. Let 
y be the smallest power of x in A. Assume (A, G, A/M) is exceptional. We may 
assume that some power of y G M. Then Cc(y) Q H. In particular, H is an 
irreducible subgroup of G. Since x has even order, it follows that xg and x are 
conjugate in A for g an involution in Cg{x). Indeed, we can find an involution 



z G Ca(g) with zxz = xg. It follows by Lemma 3.4 that z G M. In particular, 
the order of H is divisible by 4. The only such subgroups of G are L 2 (2 fc ) 
with b dividing a. In particular, the G-conjugacy class of such a subgroup is 
A-invariant, whence we may assume that A = Aut(G) and M — NA(if). 

We claim that (6, a/b) — 1. Suppose not, and let p G {2, 3} with p dividing 
a/b. Put U = N A (L 2 {2 a /P). Then (A,G,A/[/) is exceptional by Lemma p| 
Write a = p^d, where d is prime to p. Set y = x p . Then Cc(y) — Li(2 v ). 
Moreover, if y' G M is conjugate to y in A, it follows (by Lang's theorem) that 
Cm(u') n G is isomorphic to a subgroup of Cc(y). In particular, [Ca{v') ■ 
Cm{u')] is divisible by p for any such y' . It follows that the number of fixed 
points of y is divisible by p and also for x, a contradiction. 

All that remains to prove is that (A, G, A/M) is exceptional for H = L2(2 b ) 
whenever (6, a/b) = 1, where we take A = Aut(G) and M — N J 4(_ff). This 
follows by Theorem |3.15| . □ 



Theorem 3.28. Let G = L 2 (p a ) with p odd and p a > 3. Let X = Aut(G). 
Let H be a proper subgroup of G. There exists a subgroup A of Aut(G) and 
a subgroup M of A such that A — MG, M n G = H , A/G is cyclic and the 
triple (A, G, A/M) is exceptional if and only if A < Nx(H)G and one of the 
following holds: 
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(a) H = L 2 (p b ) with (a/b,p 2 - 1) = 1; 

(b) a is even and H is contained in the normalizer N of a split torus of G 
and [N : H] is not divisible by any prime dividing \L2(p)\; 

(c) p — 3, a is odd or a/2 is odd, and [G : H] is odd. 

Proof. Let H, A and M be given satisfying the hypotheses. 

We will handle the case p = 3 and a is odd at the end of the proof. So we 
exclude this case for the moment. 

Let / be the largest power of 2 dividing a. Let U = Li(j>5~) < G. Note 
that all subgroups of G isomorphic to U are conjugate in G. Thus, we may 
choose x £ A which normalizes U and generates A/G. Since x has a fixed point 
on A/M, we may replace M by a conjugate and assume also that x £ M. It 



follows by Lemma 3.8 that (Ax, U, A\/Mx) is exceptional where A\ = <U,x> 
and Mi = M n A x . 

Note that Mi may contain a central subgroup of A\ (i.e. the Ca(U)) and 
so we may pass to a homomorphic image which we still call A\. Now A%/U is 
a 2-group, whence it follows that [Ai : Mi] is odd. 

We claim that one of the following holds: 

(i) Ai = Mi; or 

(ii) / > 1 and Mi n U contains both a Sylow 2-subgroup of U and a cyclic 
subgroup of order (p 2 — l)/2; or 

(iii) pf = 9 and Mi contains a Sylow 2-subgroup of A\ . 

Suppose A\ ^ M\. We may replace i by a power and assume that x is a 
2-element (since A\jG\ is a 2-group). Let J% be a maximal subgroup of A\ 
containing M\. This implies (using the fact that Mi has odd index in A\) that 
Hi := Ji fl U is the normalizer of a torus, or Hi is A4 or S4. If / > 1, then 
a Sylow 2-subgroup of U has order at least 8 and if / > 2, then a Sylow 2- 
subgroup has order at least 16. Since Hi has odd index in U, this implies that 
if Hi = A4 or S4, then either / = 1, or / = 2 and Hi = S4. 

On the other hand, Mi n U contains elements of order (p± l)/2. Moreover, 
if a is even, then x preserves the conjugacy class of elements of order p± 1, and 
so Mi n U contains such elements. If p > 5, then A4 and S4 cannot contain 
such elements. The same holds if p — 5 and / > 1. Thus, the only possibility 
for Hi = A4 is with / = 1 and p = 5 (note that the case p = 3 with / = 1 is 
excluded). It is straightforward to see that the triple is not exceptional. 

Similarly, if Hi = S4, the only possibility is pf = 9. This case can occur. 
We deal with this case below. 

So for now we assume that p' ^ 3 and p* 7^ 9. 

Thus (i) or (ii) holds. Note that it is straightforward to check that if (ii) 
holds and not (i), then x must induce a field-diagonal element on U (otherwise, 
x induces a diagonal automorphism and all scmisimplc classes are fixed by x or 
x induces a field automorphism and all unipotent classes are fixed - in either 
case, we see that Ai — Mi). 
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First assume that (i) holds. We continue to exclude the case that p — 3 and 
a is odd. 

Thus we may assume that L 2 (p f ) C H. It follows that H = L 2 {p b ) with a/b 
odd. Let r be an odd prime dividing a/b. We claim also that r does not divide 
p 2 — 1. Suppose it does. It suffices to assume that H = L 2 {p a / r ). Let y denote 
the Frobenius automorphism on G which we assume normalizes H. Then we 
may take x = y l or x — y l z where z induces the diagonal automorphism on G 
(and normalizes H). Since r\p 2 — 1 then r divides the order of a torus, split or 
nonsplit, and we may take z to centralize this torus. Then we may choose g in 
this tor us s uch that g £ H but g r G H . Then gxg^ 1 G M, whence g G M by 
Lemma 3.4, a contradiction. 

We prove next that if H = L 2 (p b ) with (a/b,p 2 — 1) = 1, there is an excep- 
tional triple. By induction (and the transitivity property for exceptionality), we 
may assume that a/b = r c for r a prime and r c+1 not dividing a. We distinguish 
two cases, r = p and r ^ p. 

First consider the case that r ^ p. Let x be the element in Aut(G) generating 
the full group of field automorphisms (and normalizing H) . Write x = yz = zy 
where y is an r-element and z is an r'-element. We may take H = Ca(y)- We 
will show that xg has at most 1 fixed point for every g 6 G. Assume that xg has 
a fixed point. So we may assume that g G H . Write xg = y'z' = z'y' where y' is 
an r-element and z' is a r'-element. By Lang's Theorem, Cgfij) is an r'-group. 
Thus, y' is the unique Sylow r-subgroup in CA(xg). Also, y <E CA(xg) (since 
g £ H) and y and y' have the same order r c . Since yG = y'G, this implies 

y = v' ■ 

Now suppose that xg' G M is conjugate to xg in A. Arguing as above, we 
see that the r-part of xg' is y. Then the conjugacy in A implies conjugacy in 



Ca(?/) = M. Moreover, CA^xg) C Ca(2/) = M, whence Lemma 3.1 implies 
that xg has one fixed point. 

Now consider the case r — p. Let a generate the full group of field automor- 
phisms. Let r denote a diagonal automorphism which centralizes a split torus 
normalized by a. Let x = <jt. We argue as above. So let x = yz = zy where y 
is a p-element and z is a p'-element. We may take H = Cc(y)- Since r switches 
the two conjugacy classes of elements of order p in G and a fixes the classes, 
xg switches the two classes for any g G G. It follows that Cg(£<?) is a p'-group. 
Now we argue as above to conclude that xg has at most 1 fixed point for all 
geG. 

Now consider (ii). The only possible subgroups H either are contained in 
the normalizer TV of a split torus or are a subfield group. The latter we handled 
above. It is clear from (ii) that H must contain (up to conjugacy) the normalizer 
of the split torus of L 2 (p 2 )- Let x be the product of a diagonal automorphism 
and a field automorphism of even order (recall a is even in this case). In this 
case the normalizer of the split torus is precisely the centralizer of an involution 
in G. Thus, we can identify the set we are acting on with the set of involutions 
in G. Now one computes that for any such x normalizing N, Cg(i) is cyclic 
of order go ± 1 for a suitable power go of p (see the proof of Example 3.19). In 
particular, x centralizes a unique involution. Thus, each element in the coset 
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xG fixes at most 1 point and the cover is exceptional. It is straightforward to 
see that (N, H, N/H) is exceptional precisely given the conditions in (b). 

Next consider the case p = 3 and a > 1 is odd. Let x <E Aut(G) be the 
commuting product of a diagonal automorphism of order 2 and the field auto- 
morphism of order a. So let y — x % £ A with yG generating A/G. Now Cq[x) is 
a generated by an involution t, and F := 2 (Cg(j: 2 )) is an elementary abelian 
group of order 4 which is y-invariant. Since y centralizes F/(t), it follows by 
Lemma 3.4 that F C H . Denote the elements of F by {1, t, u, tu}. 

Note that the overgroups of F in G are the subgroups of Ca(t) (a dihedral 
group of order 3° + l) and the subgroups L 2 (3 b ) with b\a. These latter subgroups 
are just the centralizers of x 2a / b . Thus, it suffices to show that (A, G, A/F) is 
exceptional for A = Aut(G). Suppose xg has at least one fixed point. Thus, 
we may assume that g £ F. Then x and xt are conjugate in M — <F,x> and 
xu and xtu are conjugate in M. Since xu has order 4a and x has order 2a, 
x and xu are not conjugate in A. Note that Cg(x) = <t>. Also Cg{xu) C 
Cg(x 2 ) = £2(3). On the other hand, xu cannot centralize an element of order 
3 (since it switches the two conjugacy classes of elements of order 3 in G). Thus 
Cg{xu) = Cg{x) C F. It follows by Lemma that xg has a unique fixed 
point for every g £ F, whence the same is true for every g £ G, as desired. 

Finally, consider the case that p' = 9. As we noted above, it follows that HD 
G contains a Sylow 2-subgroup of £2(9) (which is a Sylow 2-subgroup of G). Let 
x be the product of a field automorphism of order a/2 and a commuting diagonal 
automorphism of order 2. Let A = G(x). As above, it follows that (A, G, A/M) 
is exceptional with M = L 2 (9)(x) (because (a/2,p 2 — 1) = (a/2,2) = 1). Also, 
one checks easily that (M, £ 2 (9), M/H) with H a Sylow 2-subgroup of M is 
exceptional (this example is given in terms of Aq for the main theorem). Thus, 
(A, G, A/H) is exceptional and the same is true for any overgroup of H . □ 



The previous results (and their proofs - which indicate the possibilities for 
A) give the classification of all quadruples (A, B, G, A/M) where G = £2(0) or 
PGL2(q) with B/G cyclic, A primitive on A/M and (B,G,A/M) exceptional. 

Theorem 3.29. Let L = L 2 (q) with q > 3. There exists a quadruple (A, B, G, A/M) 
with F*(A) = L, A primitive on A/M, G = L 2 {q) or PGL 2 (q) ; G < B < A 
with B/G cyclic and (B, G, A/M) exceptional, if and only if one of the following 
holds: 

(a) q = 2 a and 

(i) M PI L = L2(2 b ) with 3 < a/6 = r a prime and B/G generated 
by a field automorphism x such that Cl(x) is not divisible by r (in 
particular, r is odd and does not divide 4 a / e — 1 where e is the order 
of x); 

(ii) a > 1 is odd and M ("1 G is dihedral of order 2(q + 1); 

(b) q = p a with p odd and 
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(i) Mn L = L 2 {p b ) with r := a/b prime and r not a divisor of p(p 2 — 1), 
and B any subgroup containing an automorphism x which is either a 
field automorphism of order e or the product of a field automorphism 
of order e and a diagonal automorphism, such that r does not divide 

p 2a/e _ 1; 

(ii) M n L = L 2 {p a/p ) and B a subgroup of Aut(G) such that p\[B : G] 
and B contains a diagonal automorphism (so in fact 2p\[A : G\); 

(Hi) a is even, M fl L is the dihedral group of order p a — 1 and B/G is 
generated by a field- diagonal automorphism; 

(iv) p = 3, a odd, M n L is dihedral of order p a + 1 and B = Aut(G). 

We consider the remaining rank one groups in the next result. 

Theorem 3.30. Let L be a finite simple group of Lie type and rank 1 defined 
over ¥ q and not of type L 2 . Assume that (A, B,G, M) is such that L o A < 
Aut(L), L < G < B < A with B/G cyclic, M maximal in A, M does not 
contain L and (B,G,B/B (~l M) exceptional. Then one of the following holds 
(and all such give rise to examples): 

(i) L = Sz(2 a ) with a > 1 odd and M n L = Sz{2 a/b ) with b a prime not 5 
and a ^ b or M n L the normalizer of a Sylow h- subgroup (which is the 
normalizer of a torus ); 

(ii) L — Re(3 a ) with a > 1 odd and M fl L = i?e(3 a / fc ) with b a divisor of a 
other than 3 or 7; 

(m) L = U 3 (p a ) and L n M = U 3 (p a/b ) with b a prime not dividing p(p 2 — 1). 

(iv) L = C/ 3 (2 a ) with a > 1 odd and MdL is the subgroup preserving a subspace 
decomposition into the direct sum of 3 orthogonal nonsingular 1-spaces. 

Proof. The rank one groups other than L 2 are Sz, Re and f7 3 . There is no harm 
in assuming that G = L. 

If L = Sz(2 a ) with a > 1, then the outer automorphism group consists of 
field automorphisms and so Sz(2) < M. The maximal overgroups of Sz(2) 
are subfield groups and the normalizer of a maximal torus containing a Sylow 
5-subgroup. We may assume that A/L is generated by a field automorphism x. 

If M fl L is a maximal subfield group, it is of the form Sz{2 a / b ) with b an 
odd prime. If b ^ 5, (A, L, A/M) is exceptional by Theorem 3. 15| . If b = 5 and 



z is the 5'-part of x, then Cl(z) is divisible by b and so by Lemma 3.10, M 
contains a Sylow 5-subgroup of Cl(z), which is not the case. 

Note that M fl L is not maximal if a = b is a prime other than 3. If 
a = b = 3, then Sz(2) is the normalizer of the Sylow 5-subgroup and we are in 
the remaining case. 

Suppose that M D L is the normalizer of the maximal torus containing a 
Sylow 5-subgroup. Thus, MdL = TA where T is cyclic. We may assume 
that a; is a generator for the full group of field automorphisms (for this will 
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leave invariant the normalizcr of a maximal torus). We need to show that all 
elements in the coset x(M n L) have a unique fixed point. By raising a; to a 
power, it suffices to assume that x has odd order and so we need only consider 
elements in the coset xT. Since T — T\ x T 2 , where T\ is a Sylow 5-subgroup 
of T and [x, T 2 ] = T%, it suffices to consider elements xt with t G T\. 

Any such element centralizes the subgroup of order 5 in T. If some power of 
xt is a nontrivial element of T, then its centralizer is contained in T. Any two 
such L conjugate elements therefore would be conjugate via the normalizer of 



T and so have a unique fixed point. If (xt) does not intersect T, then by [GL83 



7.2], xt is conjugate to x. Since xt and x have centralizers isomorphic to Sz(2) 
which have a common (normal) subgroup of order 5, it follows that they are 
conjugate in M. Thus, x also has a unique fixed point. 

Next consider L = i?e(3 a ) with a odd. We may take a > 1 (since i?e(3)' = 
£2(8)). Then A/L is generated by a field automorphism. Thus, M n L con- 
tains i?e(3). The only overgroups of i?e(3) are subfield groups. So M contains 
i?e(3 a / b ) with b an odd prime. Let x be the generator of the group of field au- 
tomorphisms. Write x — yz — zy where y is a 6-element and z is a 6'-element. 
First w e sho w that b 7^ 3 or 7. If so, then Cj,(z) is divisible by b and so by 
Lemma 3.1C , M contains a Sylow 6-subgroup of Cj,(z), wh ich is not the case. 



If b 7^ 3 or 7, then we do have exceptionality as in Theorem 3.15 



Next consider L = Uj,{p a ) with p odd and p a 7^ 3. Let 1 be a generator for 
A/G. If x does not involve an outer diagonal automorphism, then x normalizes 
Oz(p a ) (and acts as a field automorphism) and so by the proof for L 2 , M contains 
Oz(j> a l h ) with b prime to p(p 2 — 1). In particular, M fl L acts irreducibly and 
primitively. Also, M contains transvections as the class of transvections is stable 
under the full automorphism group. It follows that M contains U?,(p a l b ) with b 
prime and (b,p 2 — 1). Arguing as in the previous paragraph shows that b 7^ p 
The subfield examples with (b,p(p 2 — 1) = 1 do give examples by Theorem |3.15 



Suppose that x does involve an outer diagonal automorphism. Note that 
p ^ 3 in this case. Then A/L is generated by an element of order dividing 3a and 
acts as a field automorphism on SU2(p a ) (the stabilizer of a nonsingular vector). 
It follows that M contains SU 2 {p a/h ) with (b,p(p 2 - 1)) = 1 (by the proof of the 
L 2 case) and is a subfield group allowed in the conclusion or that M n L acts 
reducibly and so M is the stabilizer of a nonsingular 1-space. A straightforward 
argument shows that this latter case is impossible (see the argument in the next 
result for the general unitary case). 

Next consider C/3 (2 a ) with a > 1. Let 1 be a generator for B/L. If a is 
even, we use the result for U2 = L 2 and see that L fl M contains L2{2 a / b ) with 
(b, 6) = 1. It follows that either MnL is the stabilizer of a nonsingular 1-space, 
a contradiction as above, or M is a subfield group satisfying the c onclusion (and 
those subfield groups do give rise to examples by Theorem 3.15 . 

So consider a > 1 odd. 

By Theorem 3.26, it follows that Lf)M contains the dihedral group of degree 
3 C where 3 C is the order of the Sylow 3-subgroup of £2(2°) = C/2(2 a ). Since M 
is maximal, this implies that one of the following holds: 
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(i) M is the stabilizer of a nonsingular 1-space; 

(ii) M contains Uz(2 a l h ), with b an odd prime; or 

(iii) MflL acts imprimitivcly on the natural module. 

We have seen before that (i) is impossible. If (ii) holds, we only need to 
show that b ^ 3. If so, write x — yz = zy where y is a 3-element and z is a 



3'-element. Then [Cg(z) : Cm (z)} is divisible by 3, contradicting Lemma p. 10 
So suppose that (iii) holds. If a is prime to 3, then let x generate A/L with 
x of order 3a (the product of a commuting diagonal automorphism of order 3 
and a field automorphism of order a). We first see that (A, L, A/ H) with H 
the normalizer of Us(2) is exceptional by Theorem |](| On the other hand, 
(H, 1/3(2), H/D) with DHL a. maximal imprimitive subgroup of L (of order 18) 
is also exceptional. Thus, (A, L, A/E) is exceptional for any overgroup E of D 
including the stabilizer of a system of three mutually orthogonal nonsingular 
1-spaces, leading to the example as given in the conclusion. 

Now suppose that 3|a. Let / be the maximal 3 power dividing a. Let x be the 
product of the field automorphism of order a and the diagonal automorphism 
of order 3 and let x generate A/L. So A/L has order a. 

Note that (A, L, A/Na(U 3 (2^)) is exceptional. By the transitivity of excep- 
tionality, it therefore suffices to assume that a = /. Note that any element in 
xL has the centralizer of order 2 • 3 h for some b. Any element of order a power 
of 3 has a fixed point as M contains a Sylow 3-subgroup of A. So we need 
consider elements xg which have even order and in particular are contained in 
the centralizer of a transvection of L. The 3-part of such an element is con- 
tained in the normalizer of a the torus of a Borel subgroup. One sees easily that 
such an element permutes an orthonormal base (indeed, fixing one 1-space and 
permuting the other 2). Thus, every element in xL has at least 1 fixed point, 
whence the result. 

Finally we show that if 6 is prime and (b,p(p 2 — 1) = 1, we do get an 
example. Let x be of order 2a (essentially generating the field automorphism 
on the field on size p 2a ). Observe that there are no x-stable conjugacy classes of 
L of elements order b in L. Thus C^( xg) has order prime to b for every g 6 L, 
whence the result follows by Theorem |3.6| . □ 

Before doing the general case, we will need the following result. 

Lemma 3.31. Let G be a simple Chevalley group over the field of q = p a 
elements. Let r be a prime dividing the order of G such that r does not divide 
the order of the Weyl group of G. Let R be a Sylow r-subgroup of G. Then 
R is a homocyclic abelian group and if q — and AI — Cg(o~) with a a field 
automorphism of order r, then M n R is contained in the Frattini subgroup of 
R. 

Proof. There is no harm in replacing G by the corresponding universal group. 



It is well known (sec [GL83, 10.1]) that R is a homocyclic abelian group (i.e. 



a direct product of cyclic groups of the same order) with the exponent being 
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equal to the r-part of 4> m (g), for a suitable m, where $ m is the mth cyclotomic 
polynomial. See the references for the value of m (the important point for us 
is that while m depends on g, it is the same for q and q^). If R = 1, there is 
nothing to prove. Otherwise, the r-part of $ m (q>) is strictly greater than the 
r-part of $ m (<7o) which is the exponent of R (1 M (note that M may pick up 
some extra diagonal automorphisms, but our assumption is that there are no 
outer diagonal automorphisms of order r). Thus, we see that the exponent of 
RflM is strictly less than that of R and since R is homocyclic, this implies that 
R D M is contained in the Frattini subgroup of R. □ 

The previous result will be used in conjunction with the following fact - if 
an r'-group S acts on an abelian r-group R, then R = [S, R] x Cr(S) and so if 
Cr(S) is contained in the Frattini subgroup of R, then Cr(S) = 1. 

Corollary 3.32. Let L = L(<?o) be a finite simple Chevalley group in charac- 
teristic p and r ^= p a prime that does not divides the order of the Weyl group 
of L. Let L < A < Aut(i) with A/L generated by x. Let M = N A (L(q )). 
If(A,G,A/M) is exceptional, then there is no conjugacy class of r- elements 
invariant under x. 

Proof. If such a class exists, then by replacing x by xg for some jeLwe may 
assume that Cl{x) contains an element z of order r. 

Then xg' normalizes a Sylow r-subgroup R of Cl(z) for some g' € Cl(z) 
and so we may assume that x does (by exceptionality, this element has a fixed 
point and so we may still assume that x £ M). Since the Sylow r-subgroup of 
L is abelian, R is a full Sylow r-subgroup of L. Since Cl(x) < M, z 6 M and 
so by the previous result, z is in the Frattini subgroup of R. 

Write x — uv — vu with u an r-element and v an r'-element. It follows that 
Cr(v) is not contained in the Frattini subgroup of R and so is not contained in 



M, By Lemma 3.10, it follows that the action is not exceptional. □ 



Theorem 3.33. Let L be a finite simple group of Lie type, defined over¥ q and 
of rank at least 2 other than Sp4 L {2)' = Aq. Assume that (A, B,G, M) is such 
that L<\A< Aut(i), L < G < B < A with B/G cyclic, M a maximal subgroup 
of A not containing L, and (B,G,B/B (1 M) exceptional. Then M n L is a 
subfield group, the centralizer in L of a field automorphism of odd prime order 
r. Moreover, 

(a) r ^ p; 

(b) if r — 3, then L is of type Sp 4 with q even; and 

(c) there are no Aut(L)- stable L-conjugacy classes of r- elements. 

Proof. The proof proceeds by induction in the following manner. We may as- 
sume that F*(A) — G is simple (replace G by F*(A) and B by <G,x> where 
B/G is generated by xG). We will choose a subgroup J of G such that the 
G-conjugacy class of J is stable under Aut(G). Thus, xg normalizes J for some 
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g G G. Replace x by xg to assume that x normalizes J. Since xg has a fixed 
point, it is in some conjugate of M (which we shall call M). Set B\ = < J, x> 
and Mi = M fl B\, Since a; G M and a; normalizes J, B\ = LM\. Then 
(B\,J,BxjM\) is exceptional (see 3. 



For example, if G = L n (q), n > 3 and let x = y l z 3 d where y is the standard 
field automorphism, z is the standard graph automorphism and d induces a 
diagonal automorphism and centralizes J = SL„_i(<7). Then letting notation 
be as above, (B%, L, By/M\) is exceptional and we may apply induction to show 
that often Mi > J. Moreover, in this situation x induces a field or graph-field 
automorphism on J and so we may avoid diagonal automorphisms. This will 
help us to identify M and show that exceptionality does not hold. 

We shall also use the following fact. If g 6 G is contained in an Aut(G)- 
stable conjugacy class, then xGnCA(g) is nonempty. Thus, g has a fixed point, 
as each element in xG has a unique fixed point. For example, if F*(A) — L n (q) 
with n > 2, then the class of transvections is stable und er Aut( L n (q)) . Thus , 
M contains transvections and we may apply results of |Kan79| and [McL69| 
to help us identify the possibilities for M. More generally, the class of long 
root elements is usually stable under Aut(G). Thus in general M will contain 
long root elements and we can use results about subgroups containing long root 
elements. 

Another tool to use to identify a subgroup as a subfield group is the result 
of BGL77| that (with very few exceptions, all of rank 1 in characteristic 2 or 
3) any subgroup of X(q) containing X(p) is a subfield group. 

We also note that conclusion (c) of the theorem implies (a) and (b) (see 

jug ). 

We now deal with the simple groups of Lie type family by family. 

First consider the case that G = L^{q). As noted, M contains transvections. 



By [FGS93], M is not parabolic. So by [Kan79 , it follows that M n G is 



either a subfield group or is the full stabilizer of a non- incident unordered point, 
hyperplane pair (and the graph automorphism is present in A) or is the unitary 
subgroup. In the last case, q = p a with a even and we apply induction to 
L 3 (p a / 2 ) to conclude that M contains L 3 (p) and so is a subfield group. 

We give a general argument below ruling out the second case. 

So we may assume that M is a subfield group and by maximality must be 
of the form £3(90) with q = q^ for some prime r. If x does not involve a graph 
automorphism or p = 2, then we may assume that x normalizes SL/2(q) and acts 
as a field automorphism on 5X2(17) ■ The proof of the £2(9) case shows that r 
is not a divisor of p(p 2 — 1). On the other hand, if stable classes of r-elements 
exist, then r is a divisor of p(p 2 — 1), a contradiction. 

If x involves the graph automorphism (and so not a diagonal automorphism) 
and p is odd, we apply the same argument to 3 (q) . 

Next suppose that G = L n (q) with n > 3. Write q = p a . Let J = SL n _i(q) 
stabilizing a 1-space and a complementary hyperplane. Then choose x generat- 
ing A/G and normalizing J. By induction on n, and Lemma 3.8, SL n ^i(p b ) < 
M for some b and a/ b is not divisible by any prime r. 

By [Kan79|, it follows that the only possibilities for MDG are the stabilizers 
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of a point or hyperplane, J or L n (j> a l r ) with r a prime. If M H G is the 
stabilizer of a point or hyperplane, G is 2-transitive and so exceptionality fails. 
If Mn G = J, assume that M is the stabilizer of the pair {U , W } in Cl = A/M 
with Uq a point and Wo a hyperplane not containing it. Then M has an orbit 
on CI of size q n ~ 2 (q n ~ 1 — l)/(q — 1) consisting of pairs {U, W} with Uq C W 
and U C Wo. This orbit is visibly transitive also under the action of G n M, 
contrary to exceptionality. 

So M is a subfield group. We need only show that there are no Aut(L)-stable 
L-classes of elements of order r. Assume the contrary. By induction, there are 
no such classes in J, whence the only possibility is that r is a primitive prime 
divisor of p n — 1 and in particular r > n and so r satisfies the hypotheses of the 
previous lemma. Thus, (c) holds. 

Next consider G = PSp 2m (p a ) with m > 2. First assume that m = 2 = p. 
Write a = ef with e odd and / a power of 2. 

If e = 1, then A/G has order a power 2 and so M contains a Sylow 2- 
subgroup of A. Since parabolic actions are not exceptional, this implies that 
the graph automorphism must be present and a — 1 (when a = 1, G is not 
the full symplectic group). In fact, we do get an example for a = 1 (the Aq 
example) . 

Thus, we see that M contains PSp 4 (2^) and so M is a subfield group (even 
if / = 1 as the example is only when G = A e not 5 6 ). The argument as for the 
linear groups shows that (c) holds. 

Next consider m > 2 = p. In this case, A/G is generated by a field automor- 
phism and so Sp2m(2) < M, It follows that M is a subfield group, Sp2m{^ a ^ r ) 
with r prime. By considering the action on Sp2 m -2(2 a ), we see that there no 
invariant r-classes in G unless possibly when r is a divisor of p 2m — 1 but not a 
divisor of p 2k — 1 for k < m. In particular, r > m and so does not divide the 
order of the Weyl group and so the previous result applies. 

Now consider p odd. Essentially the same argument shows that if M is a 
subfield group, (c) holds. So it suffices to prove that M is a subfield group. By 
induction, it suffices to prove that there are no examples when a is a power of 
2 (since the class of PSp 2m (p^) is invariant under the full automorphism group 
and any overgroup of this is a subfield group) . So assume a — f is a power of 
2. Then A/G is a 2-group and so M has odd index in A. 

Suppose m — 2 and a = 1. The centralizer of an outer involution is L2{p 2 )-2, 
which is maximal in L of even index. If a > 1, the only maximal subgroup of odd 
index is the centralizer of an involution (viewing this group as the orthogonal 
group, it is the stabilizer of a nonsingular 1-space of + type). There is a unique 
largest subdegree for G of size (q 2 — 1) (q+ 1) which is necessarily invariant under 
the full point stabilizer in A. 

Now suppose that m > 2. By induction, Sp2 m -2{p a ) < M. In particular, 
M contains transvections. There are no such proper subgroups of odd index by 
| Kan79] . 

Next take G = U n (q), q = p a with n > 4. We need to show that M is a 
subfield group. 

Let J = SUn-i(q) be the derived subgroup of the stabilizer of a nonsingular 
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1-space. We may choose a; to be a product of a diagonal automorphism (possibly 
trivial) and a field automorphism (of order dividing 2a) such that the diagonal 
automorphism centralizes J. If J < M, we see (cf. [ |Kan79j ) that M is the full 
stabilizer in A of a non-singular 1-space U. Then M has an orbit on the set 
of nonsingular 1-spaces, consisting of those 1-spaces perpendicular to U, and 
M D G is visibly transitive on this, contrary to exceptionality. 

So assume that J is not contained in M. We see by induction that unless 
p = 2, a is o dd, and n = 4, then Mn J contains a subfield group of J. It follows 
(cf. |Kan79fl ) that M is a subfield group. Moreover, there are no invariant r- 
classes contained in J and so arguing as in the linear case shows that (c) holds. 

All that remains to consider is the case n = 4 and p = 2. In this case, there 
are no diagonal automorphisms. If a = 1, the result follows (since the action 
would need to be parabolic), and so we see that 1/4(2) < M, whence ¥ is a 
subfield group. 

If G is f2 n (p a ) with n odd, then we may take n > 7 and q is odd. Considering 
subgroups J e of type 0^ 1 __ 1 (p a ) stabilizing suitable hyperplanes (with e = ±), 
we see that f2„(p) < M and so M is a subfield group. The argument as above 
shows that (c) holds. 

Next consider G = PQ. e n (p a ) with n even, n > 8. Assume first that x does 
not involve a triality automorphism. We show that M contains Pf2^(p) and 
thus is a subfield group. By induction, we may reduce to the case that a is a 
power of 2 and then M contains a Sylow 2-subgroup of G. Since the action is not 
parabolic, this forces p odd. Consider Js, a subgroup of type O s n _ 2 stabilizing 
a suitable subspace of codimension 2 (with 8 = ±). By induction, M contains 
J(p) (the subfield subgroup of J). It follows that either M is a subfield group 
or the stabilizer of a nonsingular 1-space. Write fl for the set of such 1-spaces. 
Then there is an M-orbit on f2 consisting of all those elements perpendicular 
to the one fixed by M. However, G n M is transitive on this set, contrary to 
exceptionality. 

Finally consider G = F*(A) = Pft^(p a ) with x involving the triality auto- 
morphism. Since the 3-cycles are self-centralizing in S3 and S4, it follows that x 
must be just a triality or a triality- field automorphism. Thus, G2(p) < M. If M 
is a subfield group, it follows that r does not divide | G2 (p) | and so (c) holds. It 
therefore suffices to consider the case that a = 1 (for the groups over the prime 
field form an invariant class under A and if we show that Pfl^(p) < M, then 
M is a subfield group). So assume that a = 1. Thus, M > G2{p) and [G : M] 
has order prime to 3. In particular, p 3. If p = 2, the only possibility for M 
is the normalizer of a Sylow 3-subgroup. This does not contain 6*2(2). If p > 3, 
then we still observe that no proper subgroup of G containing G2 (p) has index 
prime to 3. 

This completes the proof for classical groups. 

If G = G2(p a ), assume first that p 7^ 3 or that p — 3 and the graph auto- 
morphism is not involved. Then A/G is generated by a field automorphism and 
so G2(p) < M. By induction, we may assume that a = r and thus M contains 
a Sylow r-subgroup of G, whence r does not divide | G2 (p) | and so there are no 
invariant r-classes in G. 



So suppose that p = 3 and the graph automorphism is involved. It follows 
that 2 G 2 (3) < M. If a = 1, it also follows that M has odd index in A. There 
are no such subgroups and so M > 6*2(3) and hence M is a subfield group 
G2{p a / r )- As above, we may assume that a — r. We need only show that r is 
not 2, 3 or 7. If r = 7, we apply Lemma 3.32. If r = 2, M must contain a Sylow 
2-subgroup which it does not. If r = 3, note that |Cg(:e 3 ) : Cm(x 3 ) \ is divisible 
by 3 and so exceptionality cannot hold by Lemma |3.10| . 

Suppose that G = 2 F i {2 a ) 1 ', with a odd. If a = 1, then M contains a Sylow 
2-subgroup of G. Considering centralizers, we see that MnG contains elements 
of order 3 and 5. There is no such proper subgroup of G. Thus, M contains 
2 i<4(2)' and so is a subfield group 2 F 4 (2 a/r ) with r prime. We claim that r does 
not divide | 2 F4(2)|, whence (c) holds. 

By induction, we may assume that a — r. It follows that M contains a Sylow 
r-subgroup of G (since the outer a utomo rphism group has order r). This is not 
the case (for r > 3, apply Lemma |3.32 ; for r = 2, this is clear and for r = 3, 
inspect). 

If G = 3 D4(p a ), then A/G is generated by a field automorphism x and so 
Gvip) < M . If a = 1, then \A : G\ has order prime to 3 (since A/G has order 3), 
which it does not. Thus, M contains 3 D i (p) and is a subfield group 3 D i {p a / r ). 
We claim that r does not IG2 (_p) I ■ By induction, we may assume that a = r. If 
p =/= r > 3, apply Lemma 3.32| . If r = 3, then M contains a Sylow 3-subgroup of 
G (since A/G is a 3-group), which is visibly not the case. If r — 2 or p, Lemma 
3.10 implies that C]\i(x r ) contains a Sylow r-subgroup of Ca(x), which is not 
the case. 

If G = Fi{p a ),p ^ 2,£ 7 (2 a ) or E 8 (p a ), then G{p) < M, whence M is a 
subfield group. The standard argument shows that (c) holds. 

If G = -F 4 (2 a ), then we consider J = F 4 (2). It follows that J < M (since 
the outer automorphism group of J has order 2 and parabolic actions are not 
exceptional). It follows that ^(2) < M, whence M is a subfield group and as 
usual (c) holds. 

If G — El(p a ), we will first show that Eg(p) < M, whence M is a subfield 
group, El(p a/r ) with r prime. If x does not involve a diagonal automorphism, 
then F±{p) is contained in the centralizer of some element in the coset xG. By 
induction, we can reduce to the case that a is a power of 2 (for then there is a 
unique class of such subgroups). It follows that M contains a Sylow 2-subgroup 
of G. There is no subgroup of odd index containing F±(p). 

If x does involve a diagonal automorphism, then the graph automorphism is 
not involved (since it inverts the diagonal automorphism) . By choosing different 
elements in the coset xG, we see that M contains both A\(jp) and D\{p), whence 
M is a subfield group. 



We claim that r does not divide |i<4(p)|. If p ^= r > 5, then Lemma 3.32 
applies. If p = r or r < 5, then the class of the Levi subgroup A\(p a ) is invariant 
and so by induction, there are no invariant r-classes in the Levi subgroup, 
whence in fact r > 5 and r =/= p. 

Finally, consider G = E'ji y p a ') 1 p odd. Let / be the largest power of 2 dividing 
a. Suppose that a = f. Then A/G is a 2-group and so M has odd index in A. 



40 



We can choose a Levi subgroups of G of types E 6 (p a ) and A 6 (p a ) whose class is 
invariant and so by induction, M contains (up to conjugacy) these subgroups. 
There is no such proper subgroup. Since the class of E?(pf) is invariant under 
A, by induction, M contains Ej(pf) and so is the normalizer of E'j{p a / r ) for a 
prime r. If r does not divide the order of the Weyl group, the results above show 
that r does not divide the order of \E?(p)\. Otherwise r < 7 and we restrict to 
the Levi subgroup of type A 6 (p a ) to obtain a contradiction. 

This completes the proof of the Theorem. □ 

We finally look at the case that F*(A) is sporadic or alternating. If n = 6, 
then A 6 = L 2 (9) and the previous results apply. 

Theorem 3.34. Assume F* (^4) is A n with 6 n > 5 or is a sporadic simple 
group. If M is a proper subgroup of A, then (A, G, A/M) is not exceptional. 

Proof. Assume that (A, G, A/M) is an exceptional triple. If F*(A) — A n with 
6 =/= n > 5 then A = S n and G = A n . Then xG contains transpositions. This 
implies that the centralizer of a transposition is contained in M . Since this is a 
maximal subgroup, the only possibility is that M is this centralizer whence has 
orbits of size 2 and n — 2 (in the natural degree n permutation representation). 
On the other hand, xG also contains either an n-cycle or an (n — l)-cycle. This 
is a contradiction. 

If F*(A) = L is sporadic, then since Out(L) has order at most 2, it follows 
that A = Aut(L) ^ G = L. This implies that M must contain a Sylow 2- 
subgroup of L. Moreover, M also contains the centralizer of an outer involution. 
There are 12 of the sporadic simple groups which have outer automorphisms. In 
all but two, namely M\2 and HN, there is a centralizer of an outer involution 
which is a maximal subgroup of G and is not of odd index. In the remaining 
two cases, it is straightforward to check that there is no maximal subgroup of 
odd index containing the centralizer of an outer involution. □ 

4 Genus condition 

In this section, we will use our earlier classification of exceptional triples to 
determine the group theoretic possibilities for arithmetic exceptionality. We 
first discuss some general properties of genus systems. 

4.1 Genus systems in finite permutation groups 

In the following we assume that G is a transitive permutation group on a finite 
set X of size n, and let T = (x\, X2, • ■ ■ , x r ) be a generating system of G with 
the product relation X1X2 ...x r = 1. Recall that for x G G, the index ind(x) 
is defined to be n minus the number of cycles of x, and in accordance with the 
results in Section ^, we say that T is a genus g system if 

r 

md(xi) = 2(n - 1 + g). 

i=l 
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We define the type \T\ of T as ■ ■ ■ , \x r \). 

While determining possible genus systems in specific groups using (in- 
equalities for the index of the elements, one can often rule out candidates 
which do fulfill the above index formula by showing that they cannot generate 
the given group. For instance, we have the well known consequence from the 
theory of polyhedral groups. 

Proposition 4.1. Suppose that the type of T is (2,2,2,2), (2,3,6), (3,3,3), 
(2,4,4), (2,3,3), (2,3,4), or (2,2, ft) (k > 2 arbitrary), then G is solvable. If 
\T\ = (2,3,5), then G = A 5 . 



The formulation of the main result Theorem 1.4 makes a distinction for the 
genus of a splitting field of f(X) — t over the field K(t). In terms of the Galois 
group, this genus is given for the above group G with respect to the regular 
action. Note that in this action, the index of x E G is given by |G|(1 — l/l x l)> 
so this regular action genus Regular is given by 

E(l-^) = p(|G|-l + 5rcgular ). 



Definition 4.2. We say that T is sub-Euclidean or Euclidean, if <? re gular is 
or 1, respectively. 



A classical result of Zariski (see | Mag74 , II. 4]) basically classifies the sub- 
Euclidean and Euclidean systems: 

Proposition 4.3. (a) IfT is sub-Euclidean, then one of the following holds. 

(i) \T\ — (n, n) for n € N, G is cyclic. 

(ii) \T\ = (2, 2, k) for k > 2, G is dihedral of order 2k. 
(Hi) |T| = (2,3,3), G = A4. 

(iv) \T\ = (2,3,4), G^Si. 

(v) \T\ = (2,3,5), G = A 5 . 

(b) IfT is Euclidean, then G" = 1, and \T\ is (2,2,2,2), (2,3,6), (3,3,3), or 
(2,4,4). 

As a consequence of part (b) of the previous proposition, we obtain 

Lemma 4.4. Let A be primitive group acting on a set of size n, and G be 
a non-trivial normal subgroup which admits a Euclidean genus system T . 
Then n — p e for an odd prime p and e — 1 or 2, and G — N xi H, where 
N = Cp acts regularly, and H is cyclic of order the least common multiple of 
\T\. Furthermore, n=l (mod |-ff|). 
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Proof. By primitivity of A, we know that G is transitive. Set N = G'. By 
the previous proposition, N is abclian. Clearly N < A, and also N ^ 1, for 
otherwise G were abelian, hence regular, contrary to T inducing a genus 1 
system in the regular action. It follows that N is transitive too, and because 
N is abelian, N is regular and a minimal normal subgroup of A (the latter 
by primitivity of A), so N — G^ for some prime p and e > 1. The results 



about polyhedral groups in [Mag 74, II. 4] show that TV = G' is generated by two 
elements. Hence e < 2. Let M be a stabilizer in .A of a point, and H = G D M. 
Then H = G/G' is an abelian normal subgroup of M. If if acts irreducibly 
on N, then 7J is cyclic and semi-regular on N \ {1}. If H is reducible on N, 
and No < N is ii-invariant, then N™ is if-invariant for each m 6 M. But 
primitivity of A implies that M is irreducible on TV, and from that we get easily 
that H acts a group of scalars on N, if we identify N with and M as a 
subgroup of GL e (p). So iJ is cyclic and semi-regular in either case, and the 
claim follows. □ 

The determination of genus systems relies on the determination of the 
exact values or lower bounds of the index. If x G G, then clearly 



1 M 



where x(u) denotes the number of fixed points of y. So if we know, for instance, 
the permutation character and character table of G, then we can compute the 
index function. In small groups, which we do not want to treat by hand, we 



make frequent use of the computer algebra system GAP [GAP95]. 

The next is a reduction result for genus systems which preserve a product 
structure. For a set X denote by S(X) the symmetric group on X. 

Lemma 4.5. Let X = Y x Z be a finite set with \Y\ — y and \Z\ — z with 
y,z > 1. Let G be a transitive subgroup of S(Y) x S(Z). Let Xi = (yi,Zi) be 
a genus system for G (where yi € S(Y) and Zi G S(Z) ), that is ^ ind(aii) = 
2(yz — 1). Then 

(a) Emd(j/ i) y) = 2( 2/ -l); 

(b) Either some Xi must have no fixed points on X , or G" — 1 and if di is the 
order of Xi, then j/j and Zi each have order di with Y](l — 1/di) = 2; 

(c) ^2 x(yi> Y) ind(zj, Z) < 2z (where x(yi,Y) denotes the number of fixed 
points of yi on Y). 

Proof. It is straightforward to compute (cf. ]GN95| , 3.2(b)]) that 

ind(si) > z ■ ind(ife, Y) + x{Vi, Y) ind(z 2 , Z). (3) 

In particular, ^ind(xi) > z(%2 ind(i/j, Y)). If (a) does not hold, then 
^ind(j/i,y) > 2y, whence ^ind(xi) > 2yz, contrary to the hypothesis. 
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Then (|) yields that 2{yz - 1) > 2z(y - 1) + £ x(Vh Y) ind(z l7 Z), and (c) 
holds. 

Suppose that each x( x i) > 0- Then x(.Vii Y) > for each i (since the number 
of fixed points for Xi is just the product of the number of fixed points for yi and 
for Zi). 

If x(Uii Y) > 1 for some i, then (|) gives a contradiction. Similarly, we see 
that x( z ij Z) = 1 for eac h i. 



Moreover, by [GN95, 3.2(a)], it follows that each Xi has a unique fixed point 
and acts semi- regularly on all other points (i.e. all other orbits have size di, 
the order of Xi). In particular, yi and Zi each have order di as well. Thus, 
2yz - 2 = YJdj - l)(yz - l)/d h whence J2( d i ~ l )l d i = 2 ; so G " = 1 by 
Proposition |4.3| (b), and {x\, . . . ,x r ) is Euclidean. □ 



Proposition 4.6 ([|Mag93|, Reduction Proposition, p. 4279]). LetG be a 
nonsolvable primitive group acting on X := K with t > 1 and preserving the 
product structure on X. Assume that \Y\ > 100 and if g £ G stabilizes Y and 
acts nontrivially on Y , then \x(g, Y)\/\Y\ < 1/7. Then there is no genus 
system of generators for the action of G on X. 

Proof. Suppose T is a genus system for G for the action on X. First, we 



apply |GN95| to observe that if T is the normal subgroup of G which acts 
coordinatewise on X, then G/T is either cyclic of order a or dihedral of order 
2a with a < 4. Now the argument in |Mag93| shows that T consists of 3 
elements. Moreover, if each element of T acts semiregularly as a permutation 
of the coordinates, then the argument in [ Mag93| shows that every nontrivial 



power of each element in T fixes at most |X|/49 points. This implies that T 
must contain elements of order 2, 3 and 7, whence G is perfect. This contradicts 
that G/T is a nontrivial solvable group. 

The remaining cases are when G/T is dihedral of or der 6 o r 8 and t = 3 



or 4 respectively. The latter case is eliminated by using [ Mag93 , Lemma K] to 
conclude that XX^j — Y)/di < 2 + 149/2400, where the di are the orders of the 
elements of T. Then this implies that T has type (2, 3, b) with 7 < b < 9 or 
(2,4, 5). However, if G/T is dihedral of order 8, every element in T has even 
order and we obtain a contradiction. 

Similarly in the case T (the image of T in G/T) is of type (2, 2, 3), we see 
that the only possibilities for the type of T are (2, 3, 8) or (2, 3, 10). In the latter 
case, the third element must be of the form an involution on 2 components and 
an element of order 5 on the third — it is easily seen that these elements do 
not generate (because 3 conjugates of the square of the third element generate 
and these 3 conjugates generate a solvable group — namely, a dihedral group 
on each copy of Y) . 

The remaining case is when T has type (2, 3, 8). Again we see that 3 conju- 
gates of the third element squared generate a nonsolvable group. This forces at 
least 2 of the coordinates of the square of this clement to have order 4. Then 
every nontrivial power of this element fixes at most |X|/49 points, whence the 
genus is positive. □ 
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An elementary consequence of [GT9C, Lemma 2.3, Prop. 2.4] allows us to 
exclude the existence of genus systems for various actions. 



Lemma 4.7. Let G be a non-solvable permutation group of degree n, which is 
not isomorphic to A§. If G admits a genus system, then there is 1 ^ g G G 
such that g fixes more than n/85 points. 

4.2 Diagonal action 



We need the following extension of Aschbacher's result [Asc92 . 



Theorem 4.8. Suppose A acts primitively and faithfully on f2 and is of diag- 
onal type. Let G be a nontrivial normal subgroup of A. Suppose that G admits 
a genus system. Then F*{A) = A^ x A5. In particular, (A,G,tt) is not 
exceptional. 

Proof. Let E = F*(A). By the Aschbacher-0 'Nan-Scott theorem, E is the 
unique minimal normal subgroup of A, whence is contained in G. Since F*(G) 
is A-invariant, it follows that F*(G) = F*(A). 

Write E = Li x ■ ■ ■ x Lt, where the Li are the components of A with Li = L 
a nonabelian simple group. Let M be a point stabilizer in A. Then H — GOM 
is a point stabilizer in G. There is an A-invariant partition A of / = {1, . . . , t} 
so that HOE — YIs^a wnere L(S) = L is a full diagonal subgroup of 

JX i£(5 Li. Of course, each <5 has the same cardinality and has size greater than 
1 (but the partition / is allowed). Since A is primitive, it follows that A is 
transitive on the set of the Li and moreover, As, the stabilizer of the block <5, 
acts primitively on S. 

Note that M = N A (E CiH). If 7 is a subset of /, let £(7) denote the direct 
product of the Li as i ranges over 7. 

We consider several cases. 

Suppose first that Gs is not transitive on S. Since As is primitive on 5, this 
implies that Gs is trivial on 5. Since G is normal in A, it follows that this holds 
for all S. Let F(S) be a subgroup of E(8) containing L(S) which is maximal 
subject to being iJ^-invariant. Note also that F(6) must miss at least 2 of the 
components in E(S) (otherwise, F(6) — E(S)). 

Moreover, we may do this in such a way so that if gd = 5', then F(S') = 
hF(5)h^ 1 where h £ H maps 5 to 6' (since G = EH and E acts trivially on /, 
there is no loss in taking g € H - moreover, h is uniquely determined up to an 
element in Hs which normalizes F(5) so that this conjugate is uniquely deter- 
mined). Let F be the direct product of the various F(S). This is H- invariant 
and so we can consider the subgroup HF. Let S be a maximal subgroup of G 
containing HF. Then S n E{6) = F(5) or E{8) for each 5. Since G = HE, S 
cannot contain E. So, E(6) acts nontrivially on the cosets of F for some 6. In 
particular, we see that there are 2 components acting nontrivially on the cosets 
of F which are not G-conjugate. Thus, if C = corec(S), we see that F*(G/G) 
is not a minimal normal subgroup, but that G/C acting on the cosets of F has 
genus (by Liiroth's theorem). This contradicts J5hi91 |. 
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Suppose next that G is transitive on I. Let F be a maximal subgroup 
containing H . Then F cannot contain any components of G (since G = HE and 
therefore H is transitive on the components - thus, if F contains a component, 
it contains E and so HE = G) . Since E is the unique minimal normal subgroup 
of G (under the assumption that G is transitive on I) , G acts faithfully on the 



cosets of F. So G is primitive and faithful on the cosets of F. Now apply [ Asc92 
to conclude that F*(G) — x as desired. 

So we may assume that G is not transitive on I but that Gs is transitive 
on 5. If I' is a G-orbit of I, it follows that I' is a union of certain subsets of 
A. Arguing as in the previous paragraph, we see that L — A$ and that /' has 
cardinality 2. Thus, A is precisely the set of G-orbits on I each of cardinality 
2. Denote these orbits by Si for i = 1, . . . , s (and so t — 2s). 

It follows that G < Gi x . . . G s where t = 2s and G l = G/C G (E(5 t )). Then 
F*(Gi) = A5 x A$ < G and we may identify f2 with fii X ■ • • X fl s . 

Write Xi — (yn, . . . ,yj S ) . We may now apply Lemma [D] and use the specific 



information given in [Asc92 Section 19] to conclude that if s > 1, then the genus 
is larger than zero. So s — 1 and F*(G) = A 5 x A 5 as desired. 

Finally, since G is transitive on the components, it follows that A/G embeds 
in Out(A 5 ). In particular, A/G has order at most 2. So (A, G, il) exceptional 
implies that |f2| would have odd order. However, |fi| = 60. This completes the 
proof. □ 

4.3 Product action 

In this section we will use some results of the almost simple case given in the 
next section. 

Theorem 4.9. Suppose F*(A) = L\ x . .. xLj with Li = L a nonabelian simple 
group with t > 1 . Let M be a maximal subgroup of A such that M does not 
contain F*(A) and M n F*(A) = R x x . . . x R t where Ri = M n Li ^ 1. Let 
G be a normal subgroup of A with A — GM. If (G,A/M) has genus 0, then 
(A,G, A/M) is not arithmetically exceptional. 

Proof. Set X = A/M. Identify X = Y X ■ ■ ■ X Y (t copies of Y where Y 
L 1 /(L 1 n A/)). So n = l l where I = \Y\. It follows by |GT9(| that some 



nontrivial clement in N a{L\) / C a[L\) fixes more than ^/85 points on Y . 



Assume the result is false. By Lemma 3.24 (Ax, L, Y) is ari thme tically ex- 
ceptional (in the notation of the lemma). By T heorems 4. 13| and 3.34 , it follows 



that L = L2(q). We now apply Theorem 4.11 to conclude that L\ and L\ n M 
must be as given in Theorem |4.1l| (a). 

Let s be the size of a nontrivial orbit of G on the components (note that 
they are all of equal size since G is normal in A) . Exclude the cases p a = 8 or 
9 for the moment. Then s cannot be greater than 1 by Lemma |4.5|, Proposition 



L6 , and Theorem [4.11 (d). 

So L = L 2 (q) with q = 8 or 9 and I = 28 or 45 respectively. 

Let T be the subgroup of G which normalizes each component. We first 
show that the minimal genus of T on X is large. 
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Wc first consider the action of T on W := Y x Y . Let T be a generating set 
for T with the product of the elements being 1. 

First suppose that T contains an element of the form (l,g). Let T be the 
remaining elements of T. By restricting our attention to the first component, we 
see that £ T , md(h u h 2 ) > 2£ 2 -2£. Thus, J2t iad(hi,h 2 ) > 2£ 2 -2£+md Y (g)£. 
Since mdy(g) > 12 (case L = £2(8)) or 18 (case L = L 2 (9)), it follows that 
g(T,W,T) - 1 > h£ or 81. 

Now assume that T contains no such elements. An inspection of the pos- 
sible elements and using the fact that in each component, the or ders of the 
elements in T are not Euclidean or sub-Euclidean, c.f. Proposition 4.3, we see 
that g(T,W,T) > 0. 

So we may assume that G 7^ T. Again, by Lemma |4.5| , this implies that 
g(G, W, T) — for W — Y s for some generating set T of G (with the product of 
the elements being 1). We show that this cannot happen. For ease of notation, 
we assume that G is transitive on the components (this amounts to passing to 
a quotient group - this quotient group need not be exceptional but we will no 
longer use that hypothesis). 

By lGN95| , we know that the action of G on the orbit of components is 
cyclic of order a or dihedral of order 2a with a < 4. Moreover (by reordering if 
necessary), T has type (a, a) or (2, 2, a) respectively. 

Let T = (xi, . . . ,x r ). First assume that G/T is cyclic. We follow the nota- 
tion in ]GN95j . There is a generating set F for T consisting (up to conjugation) 
of xi, x% and a conjugates of Xi for each i > 2. 

First consider the case that L = L 2 (9) and £ — 45. 

Note that each power of Xi for i < 3 fixes at most n/5 a points. 

Suppose that a = 4. If xj, has order at least 3, then ind(£3) > (2/3)n and 
ind(xj) > 3n/4 - 45/2 - 45 2 /4 for i = 1, 2. It follows easily that the genus is 
positive. Similarly, if r > 4, the genus is positive. So we may assume that x% 
has order 2. Then we may assume that x\ has order greater than 4 (since G 
is not Euclidean). Then ind(xi) > (7/8)(624/625)n and again we see that the 
genus is positive. 

Now consider the case that a — 3. If X3 has order at least 4, then ind(xj) > 
(2/3) (n — 45) for i < 2 and ind(x3) > (32/45)n, whence the genus is positive. 
Similarly, the result follows if r > 4 (since then ind(.T3) + ind(x4) > (4/5)n). 
So assume that r = 3. If X3 has order 3, then we may assume that x\ has 
order at least 6. Then, ind(xi) > (5/6)(124/125)n, ind(x 2 ) > (2/3) (n- 45) and 
ind(x3) > (2/3)7i, whence the result follows. If 2:3 has order 2, then either both 
X\ and x 2 have order at least 6 or we may assume that x\ has order at least 
9. Since ind(x3) > (2/5)n, it is straightforward to compute as above that the 
genus is positive. 

Next, consider the case a = 2. Then ind(x i ) > (n — 45)/2 for i < 2 and 
ind(xi) > (2/5)n for all i. It follows that r < 4. If r = 4 and say X4 is 
not an involution, then ind(a;4) > (2/3)n and again we see that the genus is 
positive. If X3 and X4 are involutions, then we may assume that X\ is not. 
Then ind(xi) > 3n/4 — 171/4 and again we see that the genus is positive. So 
r = 3. Since G is not dihedral, we may assume that x\ is not an involution. 
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Straightforward computations show that the genus is positive in all cases (first 
assume that x% has order > 4; if it has order 3 or 4, then either x\ has order 
> 6 or 4 respectively or both x% and Xi have order 4; if x 3 has order 2, then we 
may assume that x\ has order > 6 and a: 2 has order > 4). 

Now assume that G/T is dihedral of order 2a with 2 < a < 4. It is straight- 
forward as above to see that r = 3. Since G is not dihedral, it follows that 
we may assume that one of x\ and x-i is not an involution. If a = 2, then 
every nontrivial power of Xi fixes at most n/25 points. It follows easily from 
this observation that the genus is positive. The same is true for a = 3 or 4 
unless t — a. A straightforward computation of the possibilities shows that the 
genus is always positive (one needs to use the facts that G is neither Euclidean 
nor sub-Euclidean and that T can be generated by x\, a conjugate of x\ and a 
conjugates of x\). 

A similar argument shows that the genus is positive when L = £2(8) (this 
case is much easier since each nontrivial element of Aut(L) fixes 0, 1 or 4 points 
ofY"). □ 

4.4 Almost simple groups 

In this section, we consider the exceptional examples that are almost simple and 
determine which admit genus systems. 

We will also obtain some additional information which we used in Section 

O. 

The main result is: 

Theorem 4.10. Let A be a primitive permutation group of almost simple type 
and of degree n. Let G be a nontrivial normal subgroup of A, where G admits 
a genus system. Suppose there is a subgroup B of A containing A such that 
B/G is cyclic, and (B,G) is exceptional. Then one of the following holds: 

(a) n = 28, G = PSL 2 (8) of types (2,3,7), (2,3,9), or (2,2,2,3), and B = 
A = PrL 2 (8). 

(b) n = 45, G = PSL 2 (9) of type (2, 4, 5), B = M w , and A = B or PrL 2 (9). 

Theorem 4.11. Let A be a group with F*(^4) = L 2 (p a ). Let G be a normal 
subgroup of A and M a maximal subgroup of A. Assume that (A, G, A/M) is 
arithmetically exceptional. Set n — [A : M] . Let D be any subgroup of A with 
F*(A)=F*(D). 

(a) Lf there exists l^iei such that x fixes more than n/85 points, then 
one of the following holds: 

(1) p a = 8, n = 28, A = Aut(G); 

(ii) p a = 9, n = 45, G is simple, A = M w or Aut(G); 
(Hi) p a = 32, n = 496, G is simple and A = Aut(G); 
(iv) p a = 25, 49, 81, or 121, n = p a (p a + l)/2; 
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(v) p a = 27, n = 351 or 819, and G is simple; 



(b) If (G, A/M)) has genus 0, then one of the following holds: 

(i) p a = S, [A: M] = 28, A = Aut(G), G is simple and the ramification 
type is (2,3,7), (2,3,9), or (2,2,2,3); 

(ii) p a = 9, [A : M] = 45, G is simple, A = M w or Aut(G) and the 
ramification type is (2,4,5). 

(c) If (D,A/M) has genus 0, then p a — 8 or 9. If D is simple, then the 
ramification type is as given in (b). Otherwise, if p a = 8, D = Aut(G), 
then the ramification type is (2,3,9); and if p a = 9, the ramification type 
is (2,3,8) ifD = PGL 2 (9), or (2,4,6) if D = Aut(G); 

(d) In case (a), subcases (iii)-(v), every nontrivial element in Aut(F*(j4)) 
fixes at most n/7 points. 

Proof. We apply the result of the exceptionality section and consider the various 
cases. Let L = L2(p a ) and H = M PI L. Note that if each nontrivial element 
of A fixes at most n/85 points, then there is no genus system for this action 



by Lemma |4.7|. Thus, assuming (a), one need only check the cases listed in (a) 
when proving (b). 

If q > 113, then each non-trivial element in Aut(L) fixes at most n/85 points 



see |GT9C[ ), except for those cases listed in Table 1 in jLS9l| , p.267]. The only 



such case compatible with the previous theorem is p a = 121 with n — 7381. 

First consider the case that H = L 2 (p a ^ b ) with a/b a prime. The only 
possibilities are p = 2 with a = 5orp = 3 = o. In the first case, M is not 
maximal in A. In the second case, we verify easily using GAP that the non- 
trivial element with the most fixed points is an involution with 13 fixed points, 
and that no group D has a genus system. 

Next suppose that p = 2 and H is dihedral of order 2(2 a + 1). Then n = 
2 a (2 a - l)/2. Since 2 a < 113 and a is odd, it follows that a = 3 or 5 and G = L. 

First suppose that a — 5. The following table gives the fixed point numbers 
and indices of the elements x S A depending on |sc|. This table can be easily 



extracted from the information in [At85], or be computed using GAP 



\x\ 


1 


2 


3 


5 


> 5 




496 


16 


1 


1 


< 1 


ind(x) 





240 


330 


396 


> 444 



^From this table we see that the only possibility of a genus system for D 
would consist of 3 elements of order 3. But such a system generates a solvable 

Also, we see that each nontrivial x S A fixes fewer 



group, see Proposition 4T. 
than n/7 points. 

If a = 3, elements of odd order fix either or 1 of the 28 points and involu- 
tions fix 4 out of 28 points. Moreover, elements of order 7 have no fixed points. 
It follows easily that the only possible types of genus systems are (2,3,7), 
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(2,3,9), or (2,2,2,3), as in the conclusion of the theorem. Note that the type 
(2, 3, 9) can occur with D = L and D = A ut(L) as claimed. 

Now consider case (b)(iii) of Theorem 3.29] . Thus, H is dihedral of order 
p a — 1, p is odd and a is even. In particular, n — p a (p a + l)/2. From Table 1 in 
| LS9l| , p.267] we obtain p a = 9, 25, 49 or 81, or 121. 

In all but the casep° = 81, since B/G must be generated by a field-diagonal 
automorphism only, for any B with B/G cyclic and (B,G,A/M) exceptional, 
it follows that G = L. If p a = 81, then G = L or G/L has order 2 generated by 
a field automorphism. 

If p a — 9, then n = 45. One computes easily using GAP that the only genus 
systems are as stated in the theorem. The arithmetic exceptionality forces 
Mio < A. 

If p a = 25, then n — 325. One computes using GAP that there are no genus 
systems for D. 

If p a ~ 49, then n = 1225. We use the character table of the 3 different 
quadratic extensions of ^2(49) in order to compute the indices of the elements 
in PrL 2 (49). 



\x\ 


1 


2 


2 


3 


4 


5 


6 


6 


> 7 




1225 


49 


25 


1 


1 


1 


1 


1 


< 1 


ind(a;) 





588 


600 


816 


912 


980 


1012 


1016 


> 1050 



First note that a possible genus system consists of only 3 generators. As it 
may contain at most one involution, we see that the only sum of three indices 
giving 2(1225 — 1) = 2448 comes from three elements of order 3. But that leads 
to a solvable group, see Proposition 



4.1 



If p a — 81, then n = 3321. Again, using character tables of the cyclic 
extensions of £2(8!), we obtain similarly as above 



M 


1 


2 


2 


3 


4 


4 


5 


6 


> 8 




3321 


81 


41 





9 


1 


1 





< 1 


ind(a;) 





1620 


1640 


2214 


2466 


2480 


2656 


2754 


> 2900 



We see that no genus system exists for a group between L = 7^(81) and 
Aut(X) in the given action. 

If p a = 121, then n = 7381. Using GAP (or computation by hand), we 
obtain 



M 


2 


2 


3 


4 


5 


6 


6 


> 6 


ind(ir) 


3630 


3660 


4920 


5520 


5904 


6130 


6140 


> 6450 



,[From 3 • 3630 + 4920 > 14760 = 2(n - 1) we get that there are only 3 
generators in a genus system. At least two elements have order > 3, and from 
that we obtain a match in the index relation only if all elements have order 3, 
a case which does not occur. 
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Finally, consider case (b)(iv) of the previous theorem. Again, from [LS91 
Theorem 1], 3 a < 113, so a = 3 and n = 351. 

We compute a table as above of the relevant data for Aut(i2(27)). 



\x\ 


1 


2 


2 


3 


3 


4 


6 


6 


7 


> 9 




351 


15 


13 


3 





1 


3 


1 


1 


< 1 


ind(x) 





168 


169 


232 


234 


259 


288 


289 


300 


> 312 



There are two matches for the index relation. One belongs to three elements 



of order 3, which is not possible by Proposition 4.1. The other match is 2(351 — 
1) = 168 + 232 + 300, suggesting a (2, 3, 7) system. However, such a system 
clearly cannot generate a group with a non-trivial abelian quotient, so it would 
have to generate L 2 (27). However, the element of order 3 of index 232 is the 
field automorphism of £2(27), a contradiction. 

Note that in all cases, the proofs and tables show that the number of fixed 
points is at most n/7. □ 

Remark. In all examples described in the previous result, L n M is maximal 
in L. 

The next theorem is an immediate consequence of our earlier results from 
the exceptionality section. 

Theorem 4.12. Let L be a finite simple group of Lie type, defined over ¥ q 
and not of type L2. Assume that (A, B,G, M) is such that L < A < Aut(X), 
L < G < B < A with B/G cyclic, M a maximal subgroup of A not containing 
L, and (B,G, B/B n M) exceptional. Then either q > 113 or (L, B,G, M) is 
one of the following: 

(a) (Sz(8),Aut(Sz(8)),Sz(8),Sz(2) x 3); 

(b) (Sz(32),Aut(Sz(32)),Sz(32),25 : 20); 

(c) (U 3 (8),B,G,N A (9x3)), withU 3 {8) of index 1 or 3 inG, and\B/G\ = 3; 

(d) (Ll(32),B,G,N A (L e 3 (2))), with L 3 (32) of index at most 3 m G, and 5 
dividing \B/G\; 



(e) (G 2 (32),Aut(G 2 (32)),G 2 (32),G 2 (2) x 5); 

(f) (Sp 4 ( (7 ),Aut(Sp 4 ((7)),G,N yl (Sp 4 ( (Z 1 / 3 ))), withq 



or q = 64 and Sp 4 (g) 



in G of index 1 in the former and at most 2 in the latter case; 

(g) (Q+ (32), n+(32).15, 0+ (32), N A (il+ (2))); 

(h) ( 3 Z? 4 (32), J B,G,N A ( 3 D 4 (2))) ; with 3 L> 4 (32) of index 1 or 3 in G, and 5 
dividing \B/G\; 

(i) (^(32), B, G, M), with M n U 3 (32) the stabilizer of a system of imprimi- 
tivity. 
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We now show that none of the remaining examples of the preceding theorem 
has a genus system. 

Theorem 4.13. Let A be a group with F*(A) a simple group L of Lie type not 
isomorphic to £2(9) ■ Let G be a normal subgroup of A and M a subgroup of 
index n in A such that M = Na(M H F*(A)). Assume that (A,G,A/M) is 
arithmetically exceptional. Then, no nontrivial element of A fixes more than 
n/85 points on A/M . 

Proof. Write x f° r the permutation character of the action of G on A/M. By 



LS91 1 , if q > 113 then the action is not of genus zero by Lemma 4.7, because 
the fixed poin t ratio x(ff)/x(l) is < 1/85 for 1 ^ g 6 G. Thus q < 113, so by 
Theorem 



4.12 



we only have to deal with the groups listed in the conclusion of 
Theore m |4.12| . We shall show that x(s)/x(l) < V 85 f° r 1 9 <= A. We use 
Lemma 3.1 



(a) If L = Sz(8) then x(l) = 1456; the only elements of prime order in L 
fixing points of A/M have order 2 or 5 (a unique class of each), and they fix 
16(= 64/4) and 1 points respectively. An outer automorphism has a unique 
fixed point. 

(b) If L = Sz(32) with G n M = 25 : 4 then x(l) = 325376; the only 
elements of prime order in G fixing points of A/M have order 2 or 5, and they 
fix 256 (= 2 10 ~ 2 ) and 1 points respectively. All outer automorphisms have a 
unique fixed point. 

(c) If L = 1/3(8), then the degree is 34048. One computes using GAP the 
corresponding permutation character for each cyclic extension of 1/3(8) to see 
that every character value is at most 256. In particular, no element fixes more 



than n/85 points and so there are no genus systems by Lemma 4.7. 

(d) If L = L e 3 (32) with M = N A (L 3 (2)) then x(l) > 2 32 . Take e = + 
first. The elements of prime order fixing a point of A/M have order 2, 3, 5 or 7 
(and there at most two classes in A n M of any of these). The largest possible 
centralizer in G is that of an (inner) involution, of order 2 15 ( +1 ).31 < 2 21 — so 
x(s)/x(l) < 2~ 10 for any g € A,g 7^ 1. If e = — , the calculation is similar: 
the relevant prime orders are 2, 3 and 5, the largest centralizer in G has order 
2 15 • 11 • \A/L\, and we deduce that x(s)/x(!) < 2 -9 for any g £ L,g ^ 1. 

(e) If G = G 2 (32) with Gfl M = G 2 (2), then x(l) > 2 56 . The elements of 
prime order in G 2 (2) x 5 have order 2, 3 (two classes), 5 or 7 (one class). The 
largest centralizer in G is that of a central involution, of order 2 30 - 31-33, so 
< 2 40 . The assertion follows as before. 

(f) If L = Sp 4 (g) with L n M = Sp 4 (g 1/3 ), with q = 8 or q = 64, we can use 
the explicit description of conjugacy classes in |Eno72|. If q = 8 then %(1) > 2 20 . 



The elements of prime order in L n M = Sp 4 (2) have orders 2 (three classes), 3 
(two classes) and 5 (one class). The involutions fix 2 s • 21 points in two of the 
classes and 2 8 in the third. The elements of order 3 fix 252 points, the elements 
of order 5 fix 13 points. The assertion follows. If q = 64, then x(l) > 2 40 and 
exactly similar consideration shows that x(s) < 2 16 • 117 for all 1 5^ g € L. We 
need only consider outer involutions and field automorphisms. If q = 64 and 
x is an involutory field automorphisms, then x fixes | Sp 4 (8)|/| Sp 4 (2)| < 2 21 
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points. If a; is a field automorphism of order 3, then x has 1 +40 + 40 fixed 
points for q = 8. If q = 64, the contradiction is easier to observe. 

(g) If L = 0^(32) with L n M = Sl£(2), then n > 2 112 . The largest 
centralizer in G is the parabolic subgroup corresponding to the central node, so 
all centralizers have orders less than 2 90 and hence there is no problem. 

(h) Similarly, if L = 3 £> 4 (32) then again n > 2 111 whereas all the centralizers 
of elements in L have orders in G less than 2 92 . The outer elements in A have 
centralizers of order less than 2 72 . 

(i) Finally consider L — U 3 (32) with Mn[/ 3 (32) the stabilizer of an orthogo- 
nal decomposition of the natural module. If exceptionality holds, then the proof 
shows that B/G has order 15. Thus, G = L. 

Suppose that g € M(lG has prime order. If g has order 11, then \g G C\M\ < 6 
and the centralizer is not larger than the stabilizer of a nonsingular 1-space, 
whence \g G n M\/\g G \ < 1/85. If g has order 3, then g is a regular semisimple 
element and so its centralizer has order at most 33 2 and |x G nM| < 244, whence 
the fixed point ratio is less than 1/85. The only other class of prime elements 
in G fl M are transvections. Since the Sylow 2-subgroup of M H G has order 2, 
the number of fixed points of g is \C G (g) : C M {g)\ = 32 3 < 85 1 A : M|. This 
completes the proof. □ 



4.5 Affine action 

Recall that a primitive permutation group A of degree n is of affine type if A has 
an elementary abelian normal subgroup N — C£, which then is automatically 
regular. Thus A = NM is a semidirect product where M is a point stabilizer 
and M acts irreducibly and faithfully on N by conjugation. If G is a nontrivial 
(and hence transitive) normal subgroup of A, then N < G, since N is the unique 
minimal normal subgroup of A. 

The aim of this section is the following 

Theorem 4.14. Let A be a primitive permutation group of degree n = p e of 
affine type, with minimal normal subgroup N = C£. Let G be a nontrivial 
normal subgroup of A which admits a genus system T . Let g re guiar be the genus 
of (G,T) with respect to the regular action of G. Suppose there is a subgroup 
B of A containing G such that B/G is cyclic, and (B,G) is exceptional. Then 
the following holds: 

(a) Lf g r eguiar = 0, then either 

(i) n—p>3,Gis cyclic, \T\ = (p,p), or 
(ii) n — p> 5, G is dihedral of order 2p, \T\ — (2, 2,p), or 
(Hi) n = A, G = C 2 xC 2 , \T\ = (2, 2, 2), B = A 4 , A = A 4 or S 4 . 

(b) Lf g r eguiar = 1, then n = p or n = p 2 for p odd, and one of the following 
holds. 

(i) |T| = (2, 2, 2, 2), G = N x C 2 , and n>5, or 
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(ii) \T\ 
(vii) \T\ 
(iv) \T\ 



= (2, 3, 6), G = N x C 6 , and n = 
= (3,3,3), G = N x C 3 , andn = 
= (2, 4, A), G = N x C±, and n = 



1 (mod 6), or 
1 (mod 6), or 
1 (mod 4). 



( c ) If 9 regular > 1, then also G is primitive, and one of the following holds. 

(i) n = ll 2 , \T\ = (2,3,8), G = N x GL 2 (3) and B = A = N x 
(GL 2 (3) x G 5 ), or 

(n) n = 5 2 , \T\ = (2, 3, 10), G = N x S 3 and A = B = N x (S 3 x C 4 ), or 

('imJ n = 5 2 , |T| = (2,2,2,4), G/A^ is a Sylow 2-subgroup of the subgroup 
of index 2 in GL2(5), B/N is the normalizer of G/N with B/G of 
order 3, and either A = B or \A/ B\ = 2, or 

(iv) n = 5 2 , \T\ = (2, 2, 2, 3), G = N x D u and A/G is cyclic of order 2 
or 4, and B < A properly contains G, or 

(v) n = 3 2 , \T\ = (2,4,6), (2,2,2,4), (2,2,2,6), or (2,2,2,2,2), G = 
N x D 8 and \A/G\ = 2, or 

(vi) n = 2 4 , \T\ = (2,4,5) or (2,2,2,4), G = N x D i0 , B = N ys (D w x 
C 3 ), anrf A = B or A/G = S 3 . 

The proof will be considerably long and difficult. For better readability we 
divide the proof into smaller pieces. We keep the hypothesis, in particular let 
T = (xi, X2, ■ ■ ■ , x r ) be a genus generating system of G with i, ^ 1 for all i. 
Let di be the order of Xj. 



4.5.1 G is abelian 

Since G is abelian, the permutation representation is the regular representation, 
so G — N. Thus each element Xi has order p, and the genus relation gives 
rp e (l — 1/p) = 2(p e — 1), so either r — 2 and e = 1, or r = 3 and p = 2 = e, and 
(a) follows. Note that if r — 2, then p ^ 2 because then A = G. 



4.5.2 G" = 1 

Now assume that G" = 1, but G is not abelian. Since A is irreducible on 
N, N is a semisimple G-module and A permutes transitively the homogeneous 
G-components of N. Let Q be any minimal G-invariant subgroup of N. So 
N = Q P for some G-invariant subgroup P (by complete reducibility). By 
passing to G/P and using JGT90| , 3.8], it follows that G/C G (Q) is cyclic of order 



1, 2, 3, 4 or 6. Moreover, Cq(x^) = 1 for each Xi which is nontrivial in G/P. 
Since Q was arbitrary, it follows that since N = Cq(N) (because N = F*(A)), 
G/N is abelian and \G/N\ is not divisible by any prime larger than 3. 

If N = Q, then G acts irreducibly on N. Thus, G/N cyclic (as G/N is 
abelian) and each element outside of N has a unique fixed point. It follows that 
T is a Euclidean or sub-Euclidean system and G/N is cyclic of order 2, 3, 4, or 
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6. Indeed, the same argument applies as long as every element outside N has a 
unique fixed point. 

Now suppose N Q. Then we may identify £1 with P x Q with G acting 
on P and Q (by viewing G inside AGL(Q) x AGL(P)). Thus, Lemma |J(b) 
applies and so either each Xi has exactly 1 fixed point, and as above G/N is 
cyclic of order 2, 3, 4, or 6 (because G/N is faithful on Q) or we may assume 
that x\ has no fixed points. 

We may assume that X\ has no fixed points on Q (as a G-set). Since the 
action on Q is of genus 0, the argument yields that the genus zero system for G 
acting on Q is sub-Euclidean and so must be dihedral. In particular, n is odd 



and \Q\ = p. By Lemma 4.5, it suffices to show that there are no such genus 
systems with n = p 2 . Then each Xi has index (1/2) (n — 1), (l/2)(n — p), n — p or 
(n— (p+ l)/2) (in the corresponding cases that x inverts N, x is a reflection on 
N, x is a translation or a commuting product of a reflection and a translation). 
The only possible genus system is (2, 2,p) or (2, 2, 2,p) with p = 3. In the first 
case, we get a dihedral group and so n ^ p 2 . In the latter case, we repeat the 
argument to see that n cannot be bigger than 9. Then A/G has order 2 and is 
not exceptional. 

So we have shown that G/N is cyclic of order 2, 3, 4, or 6 and T is Euclidean 
or sub-Euclidean. Now use Lemma [4.4| to see that in the Euclidean case, we 
get the configurations listed in Theorem |4. 14| (b) . If T is sub-Euclidean, then 
either G is dihedral of order 2p and \T\ = (2, 2,p) — the case listed in (a) (ii) 
— or G = A^ by Proposition |4.3| (the other possibilities do not fulfill G" = 1). 
But the pair {S±, At) is not exceptional for the degree 4 action. 

4.5.3 G" ^ 1, p > 2 



Here we use the results in [GT90| and [Neu93| to determine all possibilities. 
Note that those results assume that G is primitive. Using |Neu93| and some 
fairly straightforward computations, we will see that in fact G must be primitive. 

Let M be the stabilizer of a point and set H = G n M. Then A = NM 
(a semidirect product) and G — NH (semidirect). Then G is primitive if and 
only if G acts irreducibly on N. Since A is irreducible on N, it follows that 
N = Ni®' ■ -®N S where Ni is G-irreducible. Moreover, A permutes transitively 
the isomorphism classes of the Ni (otherwise, A would leave invariant a proper 
subspace). In particular, each Ni has the same cardinality. Moreover, G/Cc(Ni) 
is nonabelian for each i (for otherwise, G' acts trivially on some Ni whence on 
each Ni by transitivity - then G" = 1 contrary to hypothesis). 

As a G-set, we may identify f2 with N and so with Ni x . . . N s . Thus, we 
may apply Lemma 4.5. In particular, the action on each Ni is genus 0. We 



may now apply [Neu93, Theorem 1.5] and Lemma 4.5 to conclude that either 



s = 1 or the genus is positive unless possibly \N±\ — 9. If p > 11, it follows from 



[GT90| that G' centralizes Ni, a contradiction as above. So p < 11. 

Let us first consider the case that \Ni\ = 9. If N = Ni, then cither G is 
2-transitive (and so exceptionality cannot hold) or G/N = Dg and A/G has 
order 2. Then we may assume that X\ and xi are in G but are not in G'. The 
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elements in G outside G' are either involutions with 3 fixed points or elements 
of order 6 with no fixed points. Since x\Xi has order 4, we see that if r — 3, we 
may assume that x± has order 2, xi has order 6 and X3 has order 4. If r > 4, 
then we see that we get the examples (2,2,2,4), (2,2,2,6), and (2,2,2,2,2) in 
the Theorem. 

Now assume that N ^ N\. We claim that in this case the genus is positive. 
Write Xi = (yi,Zi) where yi is the permutation induced by n on N\ and Zi is 
the permutation induced on N 2 © • • • ffi N s . If say, y\ = 1, then x(vi) ind(zi) > 
9(n/27) = n/3 and Lem ma 4.5 implies that the genus is positive. If x( x i) > 
for each i, Lemma 4.5 applies as well. So we may assume that x(Ui) = f° r 
some i. This implies that either yi has order 3 and ind(yi) = 6 or yi has order 
6 and ind(t/i) = 7. If r > 4, we see that ^ x(j/i) > 6. Since ind(zj) > u/27, we 
may apply Lemma 4.5 to obtain a contradiction. So r — 3. Let d\ be the order 
of yi. Since ~ 1)M > 2 (or G" = 1) and £%(?/*) < 6 (or Lemma p 

applies), the only possibilities for (di,d' 2 ,d' 3 ) are (2,4,6) or (2,8,3) where y\ is 
a noncentral involution in G/N, x(V2) = 1 and xivs) = 0. 

Moreover, in the first case, j/| is also a noncentral involution in G/N . It 
follows that y\ is a translation on N%. This implies that G/Cg{N\) is a (2, 4, 2) 
group, i.e. it must be D s and contains no elements of order 8. Since G/CciNi) 
are all isomorphic it follows that on each component we have a (2,4,6) group 
or a (2, 8, 3) group. 

By Lemma [4. 5[ we see that 3 ind(zi)+ind(z2) < 2n/9. It follows that Z\ must 
be an involution (otherwise, ind(zi) > 2n/27, contrary to the above inequality 
or z\ would induce a transvection on some component with fixed points and 
interchanging components we would not have a triple as above). Moreover, z\ 
must induce a noncentral involution on each irreducible factor (or in some factor, 
we would not have a triple as above). It follows that Z2 must induce an element 
of order 3, 4, 6 or 8 on each factor. The inequality above shows that if s > 3, 
then the genus will be positive. So we may assume that s = 2. One computes 
directly in these cases that ^ind(a;i) > 160 and so the genus is positive. 

So assume that |iVi| ^ 9. As we note d abov e, this implies that N = Ni, 
that is, G is primitive. We can now apply [Neu93, 1.5] and consider the various 
possibilities. The possibilities for the di are given there. It is just a matter of 
deciding whether exceptionality can hold. 

If p = 11, then G/N = GL2(3). Since A normalizes G, the only possibility 
is that A/G has order 5. 

If p = 7, then G/N = C3 x Ds- Since A normalizes G, the only possibility 
is that A/G has order 3. However such a pair (A, G) is not exceptional. 

If p = 5 and n = 125, then we see that a point stabilizer has a unique orbit 
of maximal size, whence exceptionality cannot hold. 

Next consider n = 25. There are 6 possibilities for G given in |Neu93, 1.5]. 
Cases 4b, 4c and 4e are all 2-transitive and so cannot be exceptional. In case 
4d, G/N is self-normalizing in GL2(5) and so A = G is not exceptional. In the 
remaining cases, A is contained in the normalizer of G and it is elementary to 
verify the theorem. 

Finally, assume that p = 3. The case n — 9 has already been handled. If 
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n = 27, then either G is 2-transitive or G/N = S4. The only possibility for A 
(since G is normal in A) would be A/N — S4 x Ci- It is straightforward to 
verify that this is not exceptional. 

The remaining case is n = 81. If G/N — S5, then A/N = S5 x C2 and we 
see that exceptionality fails. If G/N — S5 x C2, then G/N is self- normalizing 
in GL4(3) and so A = G is not exceptional. The only other possibility is that 
G/N = C2 I S4 is the monomial subgroup of GL4(3). Then the orbits of a point 
stabilizer have distinct sizes and so exceptionality cannot hold. 

This completes this subcase. 



4.5.4 G"^l,p=2 

In this section we will show that the only possibility is e = 4, leading to case 



(c)(vi). We will us the following result from [GN01|, which extends previous 
work of Guralnick, Neubauer and Thompson on genus systems in affine per- 
mutation groups. 

Proposition 4.15. Suppose that A is an affine primitive permutation group of 
degree 2 e and G is a nontrivial normal subgroup which admits a genus system. 
IfG" ^ I, then e < 6. 

So we have to go through the possibilities 2 < e < 6. 

If e < 2, then G" = 1 unless G — S4 which is 2-transitive, hence exception- 
ality cannot hold. 

If e = 3 or 5, then G is primitive and it is easy to see that this forces G 
2-transitive. 

Let H be a point stabilizer in G. 

Now suppose that e = 4. Thus, H is a subgroup of As = 1/4(2). If G has 
order divisible by 7, then either G is 2-transitive or H has orbits of size 1, 7 and 
8. In either case, exceptionality cannot hold. If G has order divisible by 5, then 
the orbits of H must be of size 1, 5, 5, 5 (by exceptionality). If G is not solvable, 
then this forces H to contain A 5 . There are two conjugacy classes of A 5 in Ag. 
One A$ is transitive on the nonzero vectors of N (namely SL2(4)) and the other 
has orbits of size 5 and 10. Thus, for any G containing A5, exceptionality cannot 
hold. 

Now suppose that G is solvable. This implies that H has either a normal 3 
or 5-subgroup. In the latter case, either G is 2-transitive or H has order 10 or 
20. Since the point stabilizer in B must permute the three orbits of size 5, it 
follows that we have \B/G\ = 3. Also, B is then 2-transitive, and we easily see 
AGLi(16) < B. From that we derive case (c)(vi). 

So finally, we may assume that F(H) = 3 (H). If 3 (H) has order 9, then 
O s (H) has orbits of size 1, 3, 3 and 9 and so exceptionality cannot hold. If 
F(H) has order 3, then since C H {F(H)) C F(H), it follows that H has order 3 
or 6. Since G" ^ 1, the latter must occur. So H = £3 and H is not irreducible 
on N. Thus, N is the direct sum of 2 copies of the irreducible 2-dimcnsional H- 
module. Then the if-orbits on N have size 1, 3, 3, 3 and 6 and so exceptionality 
cannot hold. 
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Finally, we have to look at n — 2 6 . We show that there are no examples. 
First, if A is solvable, then we use the list of solvable primitive groups of degree 
2 6 provided by GAP JGAP95 to make an exhaustive search. (The program 
used for this exhaustive search was also applied to the list of the not necessarily 
solvable primitive groups of degree p e < 50, and independently confirmed the 
list in Theorem |4. 14| (c) for this range.) 

So from now on assume that A is not solvab le. The nonsolvable irreducible 
subgroups of GL 6 (2) = L 6 (2) are given in HY7S | . Since M has index 2 6 in A, we 
are only interested in those possibilities with a quotient of order not a power of 
2, see Lemma 3.11 . This restricts attention to the A with 6X2(8) < A < rL2(8), 
SX 3 (4) < A < rL 3 (4), and C 3 x L 3 {2) < A < L 2 (2) x L 3 (2). In the first two 
of these cases, the action of the subgroup SL is already transitive on vectors, 
so the action of G is 2-transitive. In the last, the group £2(2) x L 3 (2) acts 
on the vector space as on the tensor product U <g> W, with U, W of dimension 
2, 3, respectively. There are two orbits on the non-zero vectors: If ui and u 2 
are independent in U, the orbit fli of u\ ® w\ + u 2 <8> w 2 is determined by the 
dimension i of the subspace generated by wi, w 2 in W. It is clear that fl 2 is an 
orbit also under L 3 (2), so the action is not exceptional. 



5 Dickson polynomials and Redei functions 

In this section we study the rational functions of ramification type (2, 2, n) and 
(n,n), appearing in Theorem 4.14| (a). 



Definition 5.1. Let ^ a e K with a 2 e K. Set X(X) = For neN 

set R n (a,X) = \^ 1 (X(X) n ). Then one immediately verifies R n (a,X) £ K(X). 



The function R n (a, X) is called Redei function, see [N6b89 



Recall that the Dickson polynomial of degree n belonging to a G K is defined 
implicitly by D n (a, Z + a/Z) = Z n + (a/Z) n . Also, we remind that two rational 
functions / and g over a field K are said to be equivalent, if they differ only by 
composition with linear fractional functions over K. 

Theorem 5.2. Let K be a field of characteristic 0, and f € K{X) be a rational 
function of degree n. Let \T\ be the ramification type of f. 

(a) Lf |T| = (n, n), then f is equivalent to X n or to R n (a, X) for some a G K , 
a 2 e K. 

(b) Lf \T\ = (2,2,7i), then f is equivalent to D n (a, X) for some non-zero 
a G K. 

Proof. In the following the phrase 'we may assume' means that we replace / by 
a suitable equivalent rational function. Let n be the degree of /. Part (b) is 



well known, see e. g. [Fri7C|, [Tur95|. Thus suppose that the ramification type is 
(n, n). First suppose that one of the two ramified places is rational. So we may 
assume that this place is at infinity. Then J _1 (oo) must also be rational, again 
we may assume that / _1 (oo) = 00. But this means that / is a polynomial. 



58 



Now suppose that none of the two ramified places are rational. As the 
absolute Galois group Qal{K\K) permutes these places, they are algebraically 
conjugate. Thus we may assume that they are given by t 1— > a and t i— > —a for 
some a S K \ K with a 2 G K, Then the two elements / _1 (±a) are in K[a] 
and are interchanged by the involution in G&\(K(a)\K). Thus we may assume 
without loss that / _1 (a) = a and a) = —a. The maps X > °jf+a for 

a € K fix —a and a, but are transitive on P 1 (_RT). So we may assume /(oo) = oo. 
Thus there is a polynomial R(X) G of degree less than n such that 

f(X) -a = 



f{X) 



R{X) 
{X + a) r 



R(X) 

Now eliminate R(X) from these two equations to obtain the claim. □ 

Proposition 5.3. Let n be a prime, and R n {a,X) be the Redei function as 
above. Then K(otj^) is the algebraic closure of K in a splitting field of f(X)—t, 
where C, is a primitive n-th root of unity. In particular, R n (a,X) is arithmeti- 
cally exceptional over a number field K if and only if ctjzf K. 

Proof. Let a; be a root of f(X) — t, and £ be a primitive n-th root of unity. It is 
immediate to verify that the other roots of f{X) — t are given by Xi = u>i x ; , 
where u>i = a . This shows that the algebraic closure of K in said splitting 
field is generated by the Wj. But if a € Gdl(K\K), then either uf{ — u>i or 
uji = a 2 u)i for some i, so the field generated by w,, i = 1, 2, . . . , n — 1, is 
independent of i. □ 

Similarly as above, one proves 

Proposition 5.4. Let n be a prime, and £ be a primitive n-th root of unity. 
The algebraic closure of K in a splitting field of X n — t or D n (a, X) — t (0 ^ 
a € K) is K(Q or K{C, + l/C)> respectively. 

So when K is fixed, the field of constants of D n (a,X) depends only on the 
degree n, in contrast to the case for the Redei functions. This has the following 
surprising consequence. 

Corollary 5.5. There are 3 arithmetically exceptional Redei functions of degree 
3 over Q, such that their composition is not arithmetically exceptional. 



Proof. Let £ be a primitive third root of unity. We have = y/— 1/3. For 

m G Z set f m (X) = Rz{\/— 3m, X). Then, by the previous result, the field 
of constants of f m (X) is Q(y/m). Now, by the multiplicativity of the Legen- 
dre symbol, every rational prime splits in at least one of the fields Q(\/— 1), 
Q(V — 2), and Q(v2)- So the composition of /_2, and fa is not arithmeti- 
cally exceptional by Theorem 2.10| (b). □ 
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Remark. A composition of arithmetically exceptional polynomials over Q is 
always arithmetically exceptional. This, however, is not true anymore over 



number fields. R. Matthews [Mat84, 6.5] showed that if n is the product of 
three distinct odd primes, then there is a subfield K of Q(C) (C a primitive n-th 
root of unity) such that X n is not arithmetically exceptional over K, whereas 
X d is for each proper divisor d of n. 

The permutation behavior of the Redei functions on finite fields has been 



investigated in [N6b89] 



6 Rational functions with Euclidean ramifica- 
tion type 

Let K be a field of characteristic 0, and / G K(X) be an indecomposable 
rational function. This section is devoted to the case that the Galois closure of 
K(X)\K(f(X)) has genus 1. 



From Lemma 4.4 we know that such an / has degree p or p 2 for an odd 
prime p. Furthermore, the possible ramification types are (2,2,2,2), (2,3,6), 
(3,3,3), and (2,4,4). Recall that the associated geometric monodromy groups 
are isomorphic to N x: C2, N x Cq, N x C3, and N x C4, respectively, where 
N is elementary abelian of order deg /. We will use these facts throughout this 
section. 

6.1 Elliptic Curves 

In the following we summarize some of the most basic notions and results about 
elliptic curves. There is a vast literature on this subject. Our main reference 
are the two excellent volumes | Sil86 | and [|Sil94 by Silverman. 



Let K be a field of characteristic 0. A smooth projective curve E of genus 
1 over K together with a i-T-rational point Ob is called an elliptic curve. The 
curve E is a (commutative) algebraic group with Oe the neutral element. 

There is an isomorphism, defined over Q, to a plane curve in Wcicrstrafi 
normal form, which is the projectivization of Y 2 = X 3 + aX + b, where a,b € K , 
and the discriminant of the right hand side does not vanish. 

If we choose such a WeierstraB model, then a (not unique) structure as an 
algebraic group can be defined by the requirement that the points — P, — Q and 
P + Q lie on a line, where — (x, y) := (x. —y). 

If E and E' are elliptic curves, and $ : E — > E 1 is a non-constant ratio- 
nal map defined over K, then $ is automatically a surjective morphism, and 
the modified map P 1— * $(P) — $(Og) + Oe> is a homomorphism of algebraic 
groups. Such maps are called isogenics. If furthermore E — E', then we talk of 
endomorphisms, and an automorphism is a bijective endomorphism. 

The structure of the automorphism group Aut(P) of an elliptic curve is very 
easy: Suppose that E is given in WeierstraB form Y 2 — X 3 + aX + b. There is 
always the automorphism of order 2, P t— ► — P, which, expressed in coordinates, 
is (x,y) <— > (x,—y). If ab 7^ then there are no other automorphisms. Next 
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suppose that 6 = 0. Setting i := ^—1, we have the automorphism (x,y) i— » 
(—x, iy) of order 4. This generates the whole automorphism group. Now suppose 
that a = 0, and let lo be a primitive 3rd root. Then (x, y) i— ► (an, — y) has order 
6, and generates the automorphism group. 

A very specific class of endomorphisms is the multiplication by to map P i— > 
mP. This map is usually denoted by [to], and its kernel by _E[m]. The kernel, as 
a group, is isomorphic to C m x C m . More generally, if <I> : E — > is an isogeny, 
then wc denote the kernel by E\<&\. The order of the kernel is the degree of the 
map $. 

If K = Q, then the only endomorphisms of E which are defined over Q 
are the multiplication maps [to]. In general, there are two possibilities: The 
only endomorphism are the maps [to], or K contains an imaginary quadratic 
field k, and the endomorphism ring is isomorphic to an order of k. In this case 
one says that E has complex multiplication. On this plane curve level, it is 
not possible to understand these endomorphisms. Instead, one has to choose 
an analytic isomorphism between E(C) and C/A, where A is a lattice. Then 
the endomorphisms of E are induced by multiplication with / a £ C with 
aA C A. Without loss assume that A is generated by 1 and w e C\M. If there is 
an a G C \ Z with aA C A, then it follows easily that u> is imaginary quadratic, 
and the set of a's with aA C A is an order in the ring of integers of k — Q(w). 
Later we will be concerned only with the case that the endomorphism ring is 
the maximal order Ok of k. If this is the case, then A can be chosen to be 
a fractional ideal of k. If a e Ok corresponds to an endomorphism $ of E, 
then the algebraic conjugate of a corresponds to the dual endomorphism. In 
particular, the degree of <E> is the norm Nuq(a). 

We have described the structure of the automorphism group of E. In our 
development, we will obtain isomorphisms (as algebraic curves) of E to itself 
(defined over K) which not necessarily fix the origin. Denote this group of 
isomorphisms by Isom(.E). If [3 £ Isom(.E), then [3 : P i— > (3(P) — (3(0) is 
in Aut(-E). Thus Isom(^), as a group acting on E(K), carries the natural 
structure as a semidirect product E(K) x Aut(_E). 

Lemma 6.1. Let (3 e Aut(£) have order to > 1. Then l+/3+/3 2 H h/3 m_1 = 

0. 

Proof, (p := 1 + (3 + (3 2 + ■ ■ ■ + (3 m ^ 1 is an endomorphism of E, so either ip = 0, 
or (p is surjective on E(K). The latter cannot happen, because each element in 
the image of <p is fixed under (3. Thus ip = 0. □ 

From that we obtain 

Corollary 6.2. Let (3 e Isom(S) with (3{P) = (3(P+w), where 1 ^ (3 e Aut(E) 
and w € E(K). Then (3 and (3 have the same order. 

Lemma 6.3. Let ip : E — > C be a covering of finite degree to a curve C . 
Suppose that ip does not factor as E — > E' — > C where E — > E' is a covering of 
elliptic curves of degree > 1. Then ip(P) — ^p{P + w) for all P G E(K) and a 
fixed w € E(K) implies w = 0. 
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Proof. Suppose that w ^ 0. As the fibers of ip are finite, we obtain that w 
has finite order. Thus E/<w> is an elliptic curve E', and ip obviously factors 
through E — > E/<w>. □ 



Corollary 6.4. Let 1 ^ (3 G Aut(P) be defined over Kp D K , w G E(K), and 
set P(P) '■= (3{P + w) for P G E. Then the quotient curve E / <fi> has genus 
0. Suppose that ip : E — > E/<[3> is defined over Kp. Then w G E(Kp). 

Proof. Clearly f3 has a fixed point on E. This point is ramified in the covering 
E — > E/</3>. However, by the Riemann-Hurwitz genus formula, a covering of 
genus 1 curves is unramified. Thus E/</3> has genus 0. 

Set G^ := Gal(K\Kp). Apply 7 G G^ to ip(P) = tp(j3(P)) for P a generic 
point on E to obtain 

^(/3(P)+w)=^(P)) 

= tP(P(P + w~>)) 



so it; 7 = w for all 7 by Lemma 6.3, hence w G E(Kp). (Note that E — > E 1 / </3> 
is a cyclic cover, and each proper intermediate curve corresponds to a non-trivial 
subgroup of <f3>, so has genus as well by the argument from the beginning 
of the proof.) □ 



6.2 Non-existence results 

In this section we associate rational functions with Euclidean ramification type 
to isogenies or endomorphisms of elliptic curves. 

Theorem 6.5. Let K be a field of characteristic 0, / G K(X) be an in- 
decomposable rational function of degree n with Euclidean ramification type 
\T\ = (2, 2, 2, 2). Then, upon linearly changing f over K , the following holds: 

There exist elliptic curves E, E' over K , a K -rational isogeny $ : E — > E' 
of degree n, a point w G E(K), such that the following diagram commutes, 
where t/5 : E — > P 1 = E/<[3> with f3(P) = — (P + w) for P G E, and likewise 
$ : E' -> P 1 = E'/<(3'> with (3'{P') = ~{P' + $(io)) for P' G P': 

E P' 
p i pi 



Remark. In general we cannot assume w = by changing the neutral element 
of the group E, for in order to do so, there must be a if -rational point y G E 
with 2y — w. Indeed, if ip : E — * P 1 is the map corresponding to w = 0, 
then '(/'(P) = X(ip(P + y)) for P G P, 2y = w, and a suitable linear fractional 
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function X(X) 6 K(X). Note that we cannot take A(X) = X, because the map 
P i — > ^(P + y) is not defined over iT unless y is if-rational. 
Similar remarks apply in the following cases. 



Theorem 6.6. Let K be a field of characteristic 0, / G K(X) be an in- 
decomposable rational function of degree n with Euclidean ramification type 
\T\ = (2,3,6), (3,3,3), or (2,4,4). Let j S {3,4,6} be the maximum of the 
entries of \T\. Then, upon linearly changing f over K, the following holds: 

There is an elliptic curve E over K with (3 G Aut(E') defined over Kp "D K 
of order j and w G E(Kp), a K -rational covering tp : E — ► P 1 = E / </3> where 
f3(P) = p(P + w), and an endomorphism $ of E defined over K of degree n 
with $(w) = w, such that the following diagram commutes: 

E — > E 

I* 

p i pi 

More precisely, we may assume the following. 

(a) LfT — (2, 3, 6), then E is given by Y 2 = X 3, — 1, w = 0e, o,nd 4>{(x, y)) = 
x 3 . 

(b) IfT = (3,3,3), thenE is given byY 2 = X 3 - {R 3 + 27 /AS 2 ) (R,S G K), 

3/: 

6Rx + 6x 2 ). 



w = (i?,3/2 v / ^35), and ij){{x,y)) = (-9RS - 9xS + 2xy - 2Ry)/(6R 2 



(c)IfT= (2,4,4), then E is given by Y 2 = X 3 + AX, w = (0,0), and 
4>((x,y)) = (x 2 -A)/(Ax). 

A consequence of the theorems is 

Theorem 6.7. Let K be a field of characteristic 0, / G K(X) be an in- 
decomposable rational function of degree n with Euclidean ramification type 
\T\ = (2,2,2,2), (2,3,6), (3,3,3), or (2,4,4). Then n = p or p 2 for an odd 
prime p. If n — p, then the following holds. 

(a) IfT = (2, 2, 2, 2) and K = Q, then n G {3, 5, 7, 11, 13, 17, 19, 37, 43, 67, 
163}. 

(b) IfT = (2,3,6) or (3,3,3), then Q(V^3) C K and n = 1 (mod 6). 

(c) IfT = (2,4,4), then Q(V^T) C K and n = 1 (mod 4). 



Proof. From Lemma 4.4 it follows that n = p or p for an odd prime p. 



Suppose that \T\ = (2, 2, 2, 2) and n — p. From Theorem 6.5 we obtain a 
rational isogeny of elliptic curves of degree p, with everything defined over Q. 
A deep result of Mazur [ Maz78| , Theorem 1] implies that p is as in the theorem. 



Next suppose that T = (2, 3, 6) and n — p. We obtain a X-rational cndo- 
morphisms of degree p of an elliptic curves which has complex multiplication 
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by the maximal order of 3). As this endomorphism is not the multiplica- 

tion map, we get y/—3 € K. Also, p = 1 (mod 6), because p is a norm in the 
maximal order of Q(y — 3). 

Analogously argue for the remaining cases. □ 



In Section 6^5 we show that such functions / indeed exist in those cases which 
are not excluded by the theorem. However, in order to keep the discussion of 
the field of constants reasonably simple, we will assume w = 0. 



Proof of Theorems 6.5, 6.6. We need a simple observation. 

Lemma 6.8. Let K be a field of characteristic 7^ 2, and q(X) = A 4 + aX 3 + 
bX 2 + cX + d G A [A] be separable. Let C be the projective completion of the 
curve Y 2 = q(X). Then C is K -birationally equivalent to an elliptic curve over 
K. 

Proof. Without loss assume that a = 0. A birational correspondence is given 

by 

V — r TI — 2X 2 

(A, Y) 1 ^ (17, V) = (2(Y + A 2 ), (4(Y + A 2 ) + 2b)X + c), 

where U, V are the coordinate functions of an elliptic curve in Weierstrafi normal 
form. □ 

The (2, 2, 2, 2)-case. Suppose that / has ramification type (2,2,2,2). Let 
A, G P 1 (A), i — 1,2,3,4, be the branch points of /. A linear fractional change 
over K allows us to assume the following: 

(a) The branch points of / are finite. 

(b) /(A) = Q(X)/ R(X) with Q,R G K[X] monic and relatively prime, and 
n := deg(/) = deg(Q) = 1 + deg(i?). 

Let Gk be the absolute Galois group of K. As Gk permutes the branch 
points among themselves, we have 

q x (X) := (A - Ai)(A - A 2 )(A - A 3 )(A - A 4 ) G K[X\. 

Let [ii be the unique non-critical point in f~ 1 (Xi). Again, Gk permutes the /Ji 
among themselves, thus 

q^X) := (A - Ml )(A - m ){X - ^){X - M4 ) € K[X\. 

The ramification data imply the existence of monic polynomials Qi G -ST [A] 
such that 
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Multiply these equations for i = 1, 2, 3, 4 to obtain 



gA (/P0)^P0(sp0) 2 , (4) 

where S(X) = Q 1 (X)Q 2 {X)Q 3 (X)Q 4 (X)/ R 2 {X) £ (Actually, one can 

easily show that S(X) = f'{X), but we do not need that here.) 

Consider the projective curves C\, C^, where the affine parts are given by 

C x : Y 2 =q x (X) 
C M : Y 2 =q^(X). 

From (g) we infer that the map 

$:(X,Y)~(f(X),YS(X)) 



induces a rational map from C M to C\ . By Lemma 6^ , there are elliptic curves 
E\, Efj, over K, which are if-birationally equivalent to C\ and C M , respectively. 
So $ induces an isogeny $ from E^ to E\. As $ -1 (P) has n — deg/ elements 
in C\ (K) for all P in an open subset of C M (K) , we get that the isogeny <1> has 
degree n. Compose the isomorphism of E^ with with the projection to the 
X -coordinates of C M . This gives a degree 2 cover rp : E^ i— > P 1 which is defined 
over if. Thus E^, has an isomorphism /3 of order 2 to itself with ^(P) = t/>(/3(P)) 



for all P £ E^{K). The claim follows from Corollary 6.4 



The (2, 3, 6)— case. As the absolute Galois group Gk of K permutes the 
branch points among themselves, but also preserves the cycle type above them, 
the branch points need to be if -rational. Without loss assume that the branch 
points belonging to the inertia generators of orders 6, 3, and 2 are oo, 0, and 1, 
and that the non-critical point in the fiber / (A) of a branch point A (which 
has to be if -rational) is A. The ramification information yields the existence of 
polynomials R, Q\ £ K[X] and a non-zero constant c £ K such that 

f{x) = cX lt(xf 

and 



f(x)-i = c (x-iy 



R(xy 



Note that /(l) = 1, so substituting 1 in the first equation shows that c is a 3rd 
power in K. Similarly, c is a square in if, as we see from substituting in the 
second equation. Thus c is a 6th power in K . Therefore we may assume that 
c = 1 by suitably changing R. 

These two equations show that the mapping 



(U,V) ^ (U ,V ) .= (ff^^.V——) 
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induces a rational map of the elliptic curve 



E: V 2 = U 3 - 1. 
to itself, sending 0_e to Oe- Namely 

n ,3 1 _ rr3 Qo(^ 3 ) 3 

R(U 3 f 
= f(U 3 ) 1 

1 ' R(U 3 ) 6 



2 



R(U 3 ) 6 

= v' 2 . 

Comparing degrees we see that this rational map has degree n = deg(/). So we 
get an endomorphism of degree n of the elliptic curve E which is defined over 
K, and the claim follows. 

The (3, 3, 3)— case. Let Aj, i = 1, 2, 3 be the branch points of /, and fn be the 
simple element in the fiber / _1 (A). Let L(X) e K(X) be the linear fractional 
function with L(\{) = fii for i = 1,2, 3. As Gk permutes the Aj, and the action 
on the Aj is compatible with the action on the /Xj, we obtain that L 7 (Aj) = /ij 
for all % and 7 G Gk- As L is unique, we have L = L 7 , so L{X) e K{X). 
Thus, upon replacing f(X) with f(L(X)), we may assume that Ai = jitj. Also, 
as before, we may assume that the Aj are finite and f (00) = 00. Set = 

n(^-Ai). 

The ramification information gives polynomial Qi(X) e -f^[A], R{X) e 
such that 

/m -A, = (X-A,)^f. 
Multiply for i = 1, 2, 3 to get 

= g(X)5(X) 3 , 

where S*(A) e X(A). Thus 

(X,Y)^(f(X),YS(X)) 

gives a degree n map of the cubic curve Y 3 = q(X) to itself. This non-singular 
cubic curve is isomorphic over K to an elliptic curve of the form V 2 = U 3 — £, 
because one of the three points at infinity is if -rational, and the cubic has the 
degree 3 automorphism (X, Y) (X,u)Y). From that we obtain the claim. 
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The (2, 4, 4)— case. The action of Gk on the branch points shows that the 
point corresponding to the inertia generator of order 2 is A-rational. So a 
linear-fractional change can move it to oo. Additionally, we assume that the 
non-critical point in / _1 (oo), which must be A-rational, is oo. An argument 
as in the previous case shows that there is i £ K and S S K(X) with 

/(A) 2 -£= (A 2 -i)S{X) A . 

Let C be the curve defined by Y 4 = A 2 — I. This curve is A-birationally equiv- 
alent to the elliptic curve V 2 = U 3 — A£U by Lemma |6.8| (The correspondence is 
given by (17, V) = (2(A + y 2 ), AY{X + Y 2 )), (A, Y) = {U 2 +A£)/(AU), V/(2U).) 
Furthermore, we have the rational map (X,Y) i— » (f(X),YS(X)) of C to it- 
self, which induces a A-rational endomorphism of degree n of the elliptic curve. 
Conclude as in the previous case. □ 

6.3 Existence results 

The existence results are, as suggested by the arguments for the non-existence 
results, based on isogenies or endomorphisms of elliptic curves. 

6.3.1 Rational functions from isogenies 

We fix a field K of characteristic and elliptic curves E and E' defined over 
K. Let $ : E — > E' be an isogeny which is defined over K. In particular, $ is 
a homomorphism of groups. 

Let N := E[$] < E(K) be the kernel of $. Furthermore, let (3 denote a 
non-trivial automorphism of E, which is defined over K, and fulfills j3(N) = N . 
Note that E'(K) = E{K)/N, so (3 induces an automorphism (3' of E' such that 
the following diagram commutes: 



— 


-y N — 


E(K) 


E\k) - 


-> 






1" 






— 


N - 


- E{K) 


± E'(K) 






Set K := K(N), the field generated by the finite coordinates of N. Note that 
N is invariant under the absolute Galois group of K because $ is defined over 
K, so if is a normal extension of K. 

Let T be the group of translations on E by elements of N. For ij g JV and 
P S E(K), let t v (P) := P + r]. The action of T is obviously defined over K. Let 
K(E) denote the function field of E over K, and let K{E) be the compositum 
of K and K(E). As usual, if p is an endomorphism (in the sense of curves) of 
E defined over K, then the comorphism p* is defined by p*{f){P) '■= f(p(P)) 
for / € K(E) and P € E(K). Similarly, <£>* is an injective homomorphism 
K(E') — > K(E) of fields. By replacing £7' with a A-isomorphic copy, we may 
assume that is the inclusion K{E') C K{E). 

We get Gal(A(£)|A(T;')) = T*. 
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Next set H := Gal{K\K). Let H act on K(E) by fixing elementwise K(E), 
and acting naturally on K. To stay confirm with the above ★-notation, we 
denote this group by if*. Finally, let [3* be the comorphisms of (3. 

As (3 is defined over K, we obtain that (3 centralizes if, so (3* centralizes if*. 

Let A < Aut(K(E)) be the group generated by T* , if* , and (3*. 

Lemma 6.9. T* is a normal subgroup of A. More precisely, if r\ G N and 
h G H, then 

(3*t*(3* 1 = i*,^, 
h*t*h* 1 = t* h ^y 

Proof. For / G K(E) and P G -B(^) we compute 

/3*i*/3*- 1 (/)(P) = /(/3(r 1 ( J P)+^)) 
= /(P + /3(77)) 
= ^(,)(/)( J P)- 

The other case is not quite analogous, because h* is not the comorphism of an 
automorphism of E. Instead, we have the relation 

h*(f)(P)=h(f(h- 1 {P))). 

Using this, we obtain 

h*t*h*-\f)(P) = h(fh*- l ){f){h-\P))) 
= h(h*- 1 (f)(h-\P)+ V )) 

= h(h-\f(h(h-\P) + h(T])))) 

= f(P + h(rj)) 
= tt {v) (f)(P). 

□ 



Lemma 6.10. There are x, z G K(E) such that K(x) and K(z) are the fixed 
fields of H* x <(3> and A = T* x (H* x <(3>), respectively. 

Proof. Let F be the fixed field of H* x <[3>. As H* is trivial on K{E) and [3* 
acts on K(E), we obtain that F is the fixed field under (3* on K{E). Let ^3 be 
the rational place of K(E) corresponding to the neutral element of E(K). As (3 
fixes this neutral element, the place is ramified. Denote by g(F) the genus of 
F. Of course g(F) < 1. But the Riemann-Hurwitz formula shows that there is 
no proper finite unramificd extension of genus 1 function fields. Thus g(F) = 0. 
Also, the restriction of ^ to F gives a rational place, so F is a rational field. 
Rationality of the other fixed field follows either analogously, or by Luroth's 
Theorem. □ 
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Write z = R(x) with R(X) € K(X) a rational function. For suitable choices 
of the above setting these functions R will be arithmetically exceptional. Thus 
we need a description of the geometric and arithmetic monodromy groups. 

Lemma 6.11. Denote by ~ the natural homomorphism 

H* x <(3*> -> (H* x </3*>)/C H * x</3 *>(T*). 

(This amounts to passing from H* x <(3*> to the induced faithful action on 
T*). 

(a) The geometric monodromy group of R(X) is T* x </?*>. 

(b) The arithmetic monodromy group of R(X) is T* x (H* x </?*>). 

Proof. By construction, the normal hull L of K(x) over K(z) is contained in 
K(E). The fix group of L is the core of H* x <(3*> in T* x (H* x </?*>), which 
is obviously the centralizcr of T* in H* x <(3*>. From that the assertion about 
the arithmetic monodromy group follows. Similarly, the geometric monodromy 
group is the Galois group of KL\K(z), and the Galois correspondence gives the 
claim. □ 

Next we give an explicit description of the field of constants in L in terms 
of AT. 

Lemma 6.12. Let K = K n L be the field of constants in the normal hull 
L of K(x)\K(z). Then K = K(ip(N)), where ip : E -> P 1 is the morphism 
corresponding to the inclusion K(x) C K{E). 

In the proof of this lemma, we need a purely group theoretic result. 

Lemma 6.13. Let U be a finite nilpotent group, and a, (3 e Aut(Z7) with a(3 = 
(3a. Suppose that for each u e U there is an integer i such a(u) = (3 l {u). Then 
there is an integer j such that a = ft . 

Proof. The proof is by induction on \U\ + \/3\. We reduce to the case that \(3\ 
is a power of a prime. For let r, s > 1 be two relatively prime divisors of \(3\. 
By induction the assertion is true if we replace the automorphisms by their rth 
or sth powers. So a r = (3 rjl and a s — (3 sj2 . But a = (a r ) m (a s ) n for suitable 
integers m and n. Let \(3\ be a power of the prime p. Similarly as above, 
considering the pth powers shows that a p = . We may replace a by a(3~3 , 
which amounts to assuming that a has order p. 

Next suppose that U is a direct product of two proper /3-invariant normal 
subgroups U\ and ~U<i. Because |/3| is a power of a prime, the group </3> acts 
faithfully on one of the t/j, say on U\. By induction, there is a j with a = ft on 
U\. Choose u\ € U\ such that the </3>-orbit is regular through u\. Let G Ui 
be arbitrary. The assumption gives an i (depending on u?) with a(3~ l \u1U2) = 1. 
So a(3- l ( Ul ),a(3- l (u2) S Ux n U 2 = {!}■ Then ft = ft by the assumption on 
u\. We obtain ot(3~i{u2) = 1, so a = ft on all of U. 
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So we are reduced to the situation that U is a g-group for some prime q. 
First suppose that q ^ p. Let <£>([/) be the Frattini subgroup of U (i.e. the 
intersection of the maximal subgroups of U). If $(J7) > 1, then by induction 
there is a j with a/3 - - 7 the trivial automorphism on U/&{U). But then a/3 - - 7 ' 
is trivial on /J as well, because the order of a/3 -3 is relatively prime to q (see 



Gor68, Theorem 5.1.4]). If however $(f ) = 1, then U is completely reducible 
with respect to (3 (by Maschke), so U is irreducible by the previous paragraph. 
Then Schur's Lemma yields the claim. 

So we are left with the case q — p. Let p m be the order of j3, and let Uq < U 
be the fix group of ft . Then </3> has only faithful orbits on U\Uq. Recall 
that a has order p. We obtain that a(u) = ft pm 1 (u) for each u G U \ Uq and 
i G {1, 2, . . . ,p — 1} depending on w. Thus U \ Uq contains a subset M of size 
> (\U\ ~ \U \)/(p- 1) > \U\/p such that a(u) = ft (u) for all u G M and j 
independent of u. Of course, a — ft holds on the group generated by M. As 
\M\ > \U\/p and 1 ^ M, we obtain U = <M> and the claim follows. □ 



Proof of Lemma [&7|. Set if = KD L. The field K is the fixed field in K under 



C//*x</3*>(? 1 *), the fix group of L. 

We first show that 4>(N) C L. Let rj £ N and /i*/3* be in the centralizer of 
T*. We need to show that (h* f3*)(ip(r))) — ip(i]). Use the fact that tp is defined 
over K to compute the left hand side: 

(h*nm)) = h*mft V ))) 

= ^(h(ftr,))). 

Thus we are done once we know that h(/3(r])) = tj. Recall that h* ft commutes 
with t v , so 

t* = tfftt^ft^h*- 1 

- h % m h 

= *h(^(77))' 

hence h((3(r))) = 77 and the claim follows. 

In order to complete the proof, we need to show that Kf)L C K(ip(N)). By 
Galois theory, this amounts to showing that the fix group of i/j(N) is contained 
in C H * x<f j* > (T*). Thus suppose that h*ft r e H* x <ft> fixes tp(r]) for each 
77 G N. By a computation as above, this implies 

tp(h(r))) = ip(r]). 

The definition of ip then shows that for each 77 G JV, there is an exponent i, 



depending on 77, such /i(^) = ftirj). By Lemma 6.13, however, this exponent 
i docs not depend on 77, so /i/3 _i is the identity map on N. As above, this is 
equivalent to h*ft~ l to commute with each t* G T*. □ 

We need a lower bound in terms of H and /3 for the field of constants. 
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Lemma 6.14. There is a canonical injection G&\(K(N)\K(ip(N))) — > </3>. 
In particular, \Gsl(K(ip(N))\K)\ > \G&L(K(N)\K)\/\0\. 

Proof. Recall that Ch* x<p*>{T*) is the fix group of L. The fix group of KL is 
C<^>(T*). Clearly, G & \{K{N)\K{if>{N))) <* G&\{KL\L) = C^ x< ^ > (T*)/C </3 
But Cjy*(T*) = 1 by the definition of if* and Lemma |6.9| , so the map com- 
ing from projection to the second component Cij* x </3*>(T'*)/C< / 3*>(T'*) — * 
</3*>/C </3 „>(T*) is injective. □ 

The following result is more or less well known, for an analytic proof (using 
Weierstrafi p-functions) see [ Fri78| . 



Lemma 6.15. Suppose that \N\ is relatively prime to |/3|. Then the ramification 
of the extension K{x)\K[R(x)) is Euclidean of type, (2,2,2,2) if\f3\ = 2, (2,3,6) 
if \/3\ = 6, (3, 3, 3) if \0\ = 3, and (2, 4, 4) if \{3\ =4. 

Proof. Let 7 be a power of [3 of order m > 1. We claim that a fixed point in 
E(K) under 7 is an m-torsion point. By Lemma 6.1 l+7 + 7 2 + - • • + 7™~ 1 = 0, 



so if P <E E(K) is fixed under 7, then = mP, the claim follows. 

The branched places of K(x) in K(E) correspond to the images under if) 
of the non-regular orbits of <(3> on K(E). As \N\ is relatively prime to |/3|, 
the non-regular orbits are mapped bijectively to the non-regular orbits under 
<f3'> on E'(K). Note that <E> is unramified. Therefore the place z 1— > A of K(z) 
is ramified in K{x) if and only if this place is branched in K(E'). Suppose 
this place is branched in K(E'), with ramification index e (e is well-defined, 
because this extension is Galois). The above considerations then imply that 
i? _1 (A) has one single point, and the remaining ones have multiplicity e. (This 
is geometrically clear, algebraically one may use Abyhankar's lemma [ [3ti93 



Prop. III. 8. 9].) Furthermore, if /i is the simple point in the fiber i? _1 (A), then 
the ramification indices of z 1— » A in K(E') and x <— > fi in K(E) are equal. Thus 
the assertion follows easily if we exhibit the functions (3 and ip in the respective 
cases: 

|/3 1 = 2. Here K(E) is the function field of a curve given by y 2 = x 3 +Ax+B, 
where A, B £ K. Then /3((x,y)) = (x,—y), and ip((x,y)) = x defines a map if) 
as required. 

\/3\ = 3. Then K(E) is the function field of y 2 = x 3 + B, B E K. Then 
(3((x,y)) = (u>x,y), where w is a primitive 3rd root of unity, and ip((x,y)) = y. 
Thus the places of K(y) which are branched in K(E) are y 1— * 00, y 1— > \AB, and 
y t— > —\/~B, all with ramification index 3. 

\/3\ — 6. We have the same curve as in the previous case, with (3{{x,y)) = 
(tux, —y) and if>((x,y)) = y 2 . The places of K(y 2 ) which are branched in K(E) 
are y 2 1— > 00, y 2 1— > B, y 2 1— > of ramification indexes 6, 3, and 2, respectively. 

|/3| = 4. Then is the function field of y 2 = x 3 + Ax, A € K. Then 

f3((x,y)) — (—x,iy), where i 2 — — 1, and if>((x,y)) = x 2 . Thus the places of 
K(x 2 ) which are branched in K(E) are x 2 1— > 00, a; 2 1— * 0, and a; 2 1— * —A of 
ramification indexes 4, 4, and 2, respectively. □ 
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6.3.2 Fields of constants 



In order to get arithmetical exceptionality of R we need to assure that the field 
of constants K is sufficiently big, in particular it need to be bigger than K. The 
following proposition shows that there are actually many instances for this to 
happen. For an elliptic curve E over K and a prime n denote by E[n] the n- 
division points and by K(E[n]) the field generated by the nonzero coordinates 
of the elements in E[n] over K. Note that G&\(K (E\n] )\ K) acts faithfully as a 
subgroup of GL 2 (Z/nZ) on E[n] = C n x C„ (see |5il86| , III, §7]). 



Proposition 6.16. Let K be a number field, t a transcendental, E t be the el- 
liptic curve defined by Y 2 = X 3 — t(l8X — 1), andp a prime. Then for infinitely 
many to € K the following holds: E to is an elliptic curve over K with SL 2 (p) < 

Gd(K(EtM)\K) < GL a (p). If K = Q, then Gal(K(E to \p\)\K) = GU(p) for 
infinitely many to € Q. 

Proof. The j-invariant of E(t) is easily computed to be j = 3456t/(2t — 1), so 
K(j) = K{t). It follows that G&\{K{t){E t [p])\K{t)) contains SL 2 (p) (or equals 



GL2(p) if K = Q), see [Lan87, 6, §3, Corollary 1]. The claim then follows from 



Hilbert's irreducibility theorem. □ 

For the construction of arithmetically exceptional rational functions of prime 
degree or of types different from (2, 2, 2, 2), we need some consequences from the 
theory of complex multiplication |)Sil94 | and class field theory |LanS 



Let E be an elliptic curve. In order to state the first result we need to 
introduce the Weber function which maps E to E/ Aut(E). More explicitly, 
assume that E is given by a Weierstrafi equation form Y 2 = X 3 + aX + b. Then 
h((x,y)) ■- x \^(E)\/2 i 

Lemma 6.17. Let K be an imaginary guadratic field. Let U be the group of 
units in Ok, cind E be an elliptic curve defined over K, which we assume to 
have complex multiplication by Ok- So U = Aut(-E). 

(a) Let $ be the multiplication by p map for an odd prime p, which is not 
ramified in Ok- Identify E[<$>] with the vector space F 2 Then 



Gel(K(E[$])\K) < 



C p 2_ 1 if p is inert in Ok, 

Cp-i x C p _i if p splits in Ok, 



where C p 2_ 1 < GL 2 (p) is a conjugate of a Singer group, and Cp—\ x Cp~ 
is a conjugate of the group of diagonal matrices. 

Furthermore 

I (Cp_i x Gp_ij/G|j/| if P splits in Ok- 



i 
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(b) If $ is an endomorphism of odd prime degree p, then 



G & \{K(E{<S>])\K) < C p _i 
Gal(K(h{E[$\))\K) S C p _i/CW 



Proof. Note that if has class number 1 by [ |Sil94 , Theorem 4.3]. We will use that 



below. Let k € Ox induce $, and let m = hOk be the ideal in Ok generated by 



n. Then E[$] is a free Ox/m-module of rank 1 (see [3il94, Proposition II. 1.3]), 
where Gal(K(E[®])\K) respects this structure. Thus Gal(K(E[$])\K) is a sub- 
group of the group of units of O^/m, and the assertion about G&\(K(E[$])\K) 
follows. 



Next we compute Gal(K(h(E[<f>]))\K). By |Sil94[ Theorem II.5.6], K(h(E[$})) 
is the ray class field of K with respect to the ideal m. 

So we are left to compute the Galois group of this ray class field. For this 

we use global class field theory. Let J = K* be the idele group of K, 

where v is running over the finite places of K, and K v are the corresponding 
completions. (In our context, we may omit the infinite places of K.) Note 
that the product is restricted, that is almost all components have to lie in the 
valuation rings of K v . Thus we still have K* diagonally embedded in J. Let J m 
be the subgroup of J such that the elements at the v—th positions are restricted 
to be in l + p m f , where p is the associated valuation ideal, and m p the exponent 
of p in m. As usual, let 1 + p° be the group of elements in K v of ;/-adic norm 
1. Passing to class groups, set C — J/K*, C m — J m K* / K* . Now the ray class 
field of K modulo m has Galois group C/C m over K. But C/C 1 = 1, as K has 
class number 1. So the the Galois group is isomorphic to 

C a /C m = 3 x K*lJ m K* 

s J 1 /{J 1 nJ m K*) 
= J7(j m t/) 

= (j 1 /^ m )/((^ m c / )/^ m )- 

But (J m U)/J m = U as J m ("I U = 1 under our assumptions, so the claim 
follows from noting that J 1 / J m = (0 K /m)*. □ 

The previous result gave only upper (and lower) bounds for the Galois group 
of K(E[$>]) over K. The upper bound is not necessarily achieved, however it 
is in most of the cases. In order to formulate the next result, we say that an 
elliptic curve with a given Weierstrafi equation over K has good reduction at 
p G P, if the reduction modulo each prime ideal dividing pOx is a non-singular 
curve. The following result, though it looks very similar to the previous one, is 
much deeper, its proof uses the main theorem of complex multiplication. See 



also [Rub99, 5.20(h)] for a similar statement. 



Lemma 6.18. Let K be an imaginary quadratic field, and E be an elliptic curve 
defined over K, which we assume to have complex multiplication by Ok- Let p 
be a prime such that E has good reduction at p. 
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(a) Let $ be the multiplication by p, and suppose that p is not ramified in Ok- 
Then 



Gal(K(E[$])\K) 



C p 2_ 1 if p is inert in Ok, 

Cp-i x Cp-i if p splits in Ok- 



(b) If <£> is an endomorphism of degree p, then 

Gal{K(E[$\)\K) = C p _i 



Proof. The uniformization theorem (see e.g. flSi!86| , §5]) gives a lattice A C C 
and an analytic isomorphism / : C/A — > E(C). Without loss assume that 
1 G A. The fact that the endomorphism ring of E is the maximal order Ok, 
and that this endomorphism ring is isomorphic to a S K with aA C A, implies 
that A is a fractional ideal of Ok- Under this identification, the points of 
finite order in E(C) are given by K/A. The torsion points of E(C) generate 
an abelian extension of K, so / maps K/A to E(K ab ). The main theorem of 
complex multiplication describes the action of Gal(K ab \K) on E(K ab ) in terms 
of the action of the idele group J on K/A. As in the previous proof, let J be 
the the idele group of K, where we again drop the factor C* coming from the 
archimedian place. In order to describe the action of J on K/A, we need to 
fix a p-primary decomposition of K/A: Let v run through the non-archimedian 
valuations of K, let K v be the completion of K with respect to and let 
A„ := AR V be the fractional ideal of K v , where R v is the valuation ring of v. 



Then (see |Sil94] §8]) 

K/A = ^K V /A V . 

Let ip : J — * C* be the Hccke character corresponding to E and K, and v be a 
valuation of K lying above the p-adic valuation of Z. As E has good reduction 



at p, [3il94, Theorem 9.2] gives ^>(-R£) = {1}- Let x € J be an idele with i„» = 1 
for v' 7^ v and x v £ R*. Note that x v A,y C A v , so <x„> acts on the quotient 
K v j ' A v by multiplication with x v . Now use the results from ]Sil94 , §9] to see 



the following: 

Use the p-primary decomposition of K/A from above to define an action 
of x on K/A: Let x v * act trivially on K v * / A v > for v 1 ^ and let x v act by 
multiplication with x u on K v /A v . Denote by [x, K] £ Gal(K ab \K) the Artin 
symbol of x. Then we have a commutative diagram 

K/A ^ K/A 

[f [i 

E(K ab ) [ ^ ] E(K ab ) 
From that we can read off the claim. □ 
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6.3.3 The (2, 2, 2, 2)-case 

We are now prepared to prove the existence of arithmetically exceptional ratio- 
nal functions of elliptic type (2, 2, 2, 2) in those cases which are not ruled out by 



Theorem 3.7 



Theorem 6.19. There exist indecomposable arithmetically exceptional rational 
functions of type (2, 2, 2, 2) 

(a) of degree p 2 for each odd prime p over any number field K. For K = Q, 
there are examples with arithmetic monodromy group as big as AGL/2(p). 

(b) over <Q> of degrees 5, 7, 11, 13, 17, 19, 37, 43, 67, 163. 

(c) of each prime degree p > 5 for some number field K. Hereby, K can 
be chosen to be the Hilbert class field of Q(V — p)j giving the arithmetic 
monodromy group to be AGLi(p). 

Proof. The construction is based on isogenies <£> : E — > E 1 and (3 £ Aut(-E) the 
canonical involution. As $(/3(P)) = $(— P) = — $(P) = /3'($(P)), we obtain 



that the kernel of $ is invariant under /3, so the results from Section 6.3.1 apply 



By Lemma 3.15, the ramification type of the associated rational function R(X) 
is correct. Let A and G denote the arithmetic and geometric monodromy group 
of R(X), respectively. 

To (a). Let K = Q and E = E' be an elliptic curve from the conclusion 
of Proposition 6.16] , and let $ be the multiplication by p map. By Lemma 



|6~TT| , we have A < ¥ 2 p x GL 2 (p) and G = ¥ 2 p xi C 2 . On the other hand, 



A/G = Gal(K(ip(N))\K), and the claim follows from Lemma 6.14 together 
with G&\(K(N)\K) = GL2(p). Similarly argue for K a number field to obtain 
ASL2(p) < A < AGL2(p). That clearly gives arithmetical exceptionality. 

To (b). First suppose that p £ {7, 11, 19, 43, 67, 163}, and set K = Q(y/=p). 
Then Ok — Z + ufL with u> = (1 + ^J—p)/2 is the ring of integers of if. Fur- 
thermore, K has class number one in these cases. Thus there exists an elliptic 



curve E over Q with complex multiplication by Ok, see [ 31186 , 11.3.1]. The 
multiplication by k = \J—p yields an endomorphism $ of degree p. We claim 
that the kernel is defined over Q (even though $ obviously is not). Let <£>' be 
a Galois conjugate of <& different from <£>. Then $' is induced by multiplication 
with —k. Passing to the lattice C/Ok, an easy computation shows that the 
kernels of z i— > kz and z i— > — are the same. Thus E[<$>] is defined over Q. 
By ]Sil86j , III.4.12, III.4.13.1], there exists a rational isogeny E -> ^/E 1 ^] with 



kernel S[$]. As E has no nontrivial automorphisms, ip is the Weber function 



on E, so Gal( J K'(V'(iV))|iir) = C {p _i) /2 by Lemma |6.17| (b). Thus the arithmetic 
monodromy group taken over K is AGL^p), so this is even more true over Q. 
The remaining cases are p £ {5, 13, 17, 37}. First suppose p = 13. Let X (p) 



and X\ (p) be the modular curves as defined in pn86| , App. C, §13]. These curves 



are defined over Q. Roughly, the non-cuspidal points of Xq classify the pairs of 
elliptic curves E and a subgroup of order p, with both defined over a field K if 
the corresponding point on Xo(p) is defined over K. Similarly for Xi(j>), with 
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the group of order p replaced by a point of order p. There is a natural covering 
map (f) '■ -X"i(p) — > -X"o(p), which amounts to sending the pair (E, P) with P E E 
of order p to (22, <P>). This covering map has degree (p — l)/2. (We need to 
divide by 2, as (E,P) and (E,—P) correspond to the same point on Xi(p).) 
Now Xq(p) is a rational curve for p — 13. Thus Hilbert's irreducibility theorem 
implies that there are infinitely many rational points Q on Xq(p), such that 
Q(Q')\Q has degree (p - l)/2 where Q' £ X 1 (p) with cf>(Q') = Q. Such a point 
Q thus corresponds to an elliptic curve over Q with an isogeny $ of degree p, 
and with [Q(N) : Q] = (p - l)/2. So [Q(^(iV)) : Q] > (p - l)/4 > 3 by Lemma 



3.14 , and arithmetical exceptionality follows. 

We finish also the cases p = 17 and 37 once we know that there is an 
elliptic curve over Q with a rational isogeny <i> of degree p and i/j(N) <f_ Q. For 
p G {17, 37} it is known that there exists an elliptic curve over Q with a rational 



isogeny of degree p, see |Maz78| and the references given there. Suppose that 
for such a curve ip(N) C Q. But then there would be a point of order p defined 
over a quadratic number field. But this cannot happen by results of Kamicnny, 



see the references in [KM95| 



So the only case left is p = 5. Here we can even give an arithmetically 
exceptional function quite explicitly. Namely let R(X) = X(11X 4 + 40X 3 + 
10X 2 - AOX - 5)/(5X 2 - l) 2 . Set q x (X) = 11X 3 - 5X 2 - 3X - 11/12 and 
q 2 {X) = X 3 ~bX 2 +7X-l. Then one verifies that q 2 (f(X)) = qi (X)(f'(X)/5) 2 , 
thus (X,Y) f — * (f(X), l/5Yf'(X)) gives an isogeny of the elliptic curve Y 2 = 
qi(X) to Y 2 = q 2 (X) of degree 5. Furthermore, no X-coordinate of a nonzero 
element in the kernel is rational, as 5X 2 — 1 is irreducible. This proves the 
claim. (We thank Ian Connell for pointing out on how to use his elliptic curves 



software apecs, available from http: / /cuclid.math.mcgill.ca~connell, to compute 
isogenies of elliptic curves.) 



To (c). The argument is a slight extension of the proof of Lemma 5.17 



again using the theory of complex multiplication [Sil94, Chapter II]. Let Kh 
be the Hilbert class field of K = Q(^/— p). Then there is an elliptic curve 
defined over Kh, which admits complex multiplication by Ok- Let $ be the 
endomorphism (of degree p) induced by k — y/—p. Set m = kOk- The field 
K' h := Kh{^{N)) is the ray class field of K modulo m. With the notation from 



the proof of Lemma |6.17 we have Ga\{Kh\K) = C/C 1 . So the proof there gives 



G&l(K' h \Kh) = C( p _i)/2. This implies that the arithmetic monodromy group of 
R over Kh is AGLi(p), and everything follows. □ 



Remark. The claim of part (c) already appears in the work of Fried, see [ Fri78| . 
His argument is completely different (using modular curves rather than complex 
multiplication) and does not give a hint about possible fields of definition. 

There is yet another proof of part (c), which does not use complex multi- 
plication. Take R(X) as in (a) of degree p 2 , (p > 5), such that the arithmetic 
monodromy group is AGL2(p). So the field of constants Q has Galois group 
GL 2 (p)/C2 over Q. Now let B be the group of upper triangular matrices in 
GL 2 (p), and K be the fixed field of B/C 2 in Q. So / has arithmetic mon- 
odromy group C 2 x B over K, so R(X) decomposes over K into two rational 
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functions of degree p. It is immediate to verify that the two composition factors 
have the right ramification, and arithmetic monodromy groups AGLi(p). 



6.3.4 The cases (2,3,6), (3,3,3), and (2,4,4) 

The next theorems treat the ramification types (2, 3, 6), (3 , 3, 3), and (2,4,4). 
The construction is based on the setting from Section |6.3.1 . Specifically, let K 



be a number field (to be specified in the theorems), E an elliptic curve with an 
automorphism /3, and <f> : E — > E an endomorphism. As the endomorphism ring 



of an elliptic curve is abelian [Sil86, Theorem 6.1 ], we obtain that the kernel of 
$ is invariant under /3. The results from Section |6.3.1 may be interpreted that 



we get a rational function R such that the following diagram is commutative: 

E E 



E/<f3>=F 1 E/<f3> =p! 



This is the motivation for talking about the rational function E/ <(3> — > Ej <(3> 
in the theorems below. For the sake of easier reading, we separate the prime 
degree from the prime square degree cases. 

Theorem 6.20. Let p be a prime with p = 1 (mod 3). Set K = Q(V _ 3), and 
let E be an elliptic curve over K with complex multiplication by Ok ■ So there is 
an automorphism (3 of order 6. There exists an endomorphism $ of E of degree 
p. The associated rational function R : E/<[3> — > E/<f3> has ramification 
type (2, 3, 6), is defined over K , and has arithmetic monodromy group AGLi(p). 



Theorem 6.21. Let p > 3 be a prime, and E be an elliptic curve over Q with 
complex multiplication by the integers of Q(V — 3). Let j3 be an automorphism 
of order 6. The rational function R : E/<f3> — > E/<[3> associated to the 
multiplication by p map has ramification type (2,3,6), is defined overQ, and its 
arithmetic monodromy group over Q is 

• (C p x C p ) x {C p 2_ 1 x C 2 ) if p = -1 (mod 3), or 

• (C p x Cp) x ((Cp_i x Cp_i) x C 2 ) if p = 1 (mod 3). 



Proof of Theorem 6.2(\ . By assumption p is a norm in Ok , so there is an en 



domorphism $ of E of degree p which is defined over K . Lemma |5.15| gives 
the correct ramification type of the associated rational function R(X). Let 
A, G < AGLi(p) be the arithmetic and geometric monodromy group of R(X) 
over K. Of course G — C p x Cq. In our case, the funct ion tp : E — > P 1 coincides 



with the Weber function h on E. So, by Lemma |6.17| (b), the field of constants 
of R(X) has Galois group C p -i/Ce. As this Galois group is isomorphic to A/G, 
and A < AGLi(p), the claim follows. □ 
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Proof of Theorem 6.21. Now let <J> be the multiplication by p map, and N = 
E[$\ the kernel. As <& and i\> are defined over Q, we obtain that R(X) € Q(X), 
even though (5 is not defined over Q. We first work over K = Q(\/— 3), and 
afterwards descend to Q. Let (C p x C p ) X C with C < GL2(p) be the arithmetic 
monodromy group of R(X) taken over K. The field of constants is K(ip(N)). 
First consider the case p = — 1 (mod 3). Note that Cg < C, and C is abelian by 
Lemma 6.11 | (b) and Lemma |6.17 (a). The Galois group of K(ip(N))\K is given 



by Lemma |6.17| (a) . We obtain C/C§ = C p 2 -x/Cq. So C is abelian of order p 2 — 1 



and irreducible (otherwise by Maschke C were a subgroup of C p _i x C p -\, so 
p + 1 would divide p — 1). Thus by Schur's Lemma C is cyclic, indeed C is a 
Singer group in Gi^Cp)- 

If p = 1 (mod 3), then we obtain similarly C/Cq = (C p _i x C p -i)/Cq. If 
the abelian group C were irreducible, then |C| = (p — l) 2 would divide p 2 — 1, 
a contradiction. Thus C = C p _i x C p _i, the group of diagonal matrices in 
GL 2 {p). 

The assertion about the arithmetic monodromy group over Q follows now 
from these two observations: ip is defined over Q, thus the extension if (-0(7V))|Q 
is normal. Secondly, K is contained in the field of constants of R(X), for 



instance by the branch cycle argument Proposition 2.2, noting that a generator 
of Cq < C is not rational in the geometric monodromy group (C p x C p ) x Cq. 
Thus, if (C p x C p ) x C is the arithmetic monodromy group over Q, then C has 
index two in C . Is is easy to see that this extension split. Indeed, C may be 
identified with F* 2 x Aut(F p 2) in the first case, or with the group of monomial 
matrices in GL2(p) in the second case. □ 

Though one might expect that the situation for the ramification type (3, 3, 3) 
is completely analogous to the previous case, there is a difficulty with bad re- 
duction. Indeed, the arithmetic monodromy group of R depends on the chosen 
elliptic curve, see Example 6.26| and Remark |6.27 . Possible choices for E in the 



following two theorems are Y = X A + B, where B € Z is not divisible by p. 

Theorem 6.22. Let p be a prime with p = 1 (mod 3). Set K = Q(^/—3), 
and let E be an elliptic curve over K with complex multiplication by Ok and 
good reduction at p. So there is an automorphism (3 of order 3. Let $ be an 
endomorphism of E of degree p. The associated rational function R : E/<(3> — > 
E/<j3> has ramification type (3,3,3), is defined over K, and has arithmetic 
monodromy group AGLi(p). 



Theorem 6.23. Let p > 3 be a prime, and E be an elliptic curve over Q with 
complex multiplication by the integers of Q(y— 3) and good reduction at p. Let 
P be an automorphism of order 3. The rational function R : E/<[3> — > Ej <f3> 
associated to the multiplication by p map has ramification type (3, 3, 3), is defined 
over Q, and its arithmetic monodromy group over Q is 

• (C p x Cp) x (C' p 2_ 1 x C 2 ) if p = —1 (mod 3), or 

• {C p x Cp) x ((Cp-i x Cp-i) x C2) if p = 1 (mod 3). 
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Proof of Theorem 6.2%.. Use the notation from the proof of Theorem |6.20 , with 
the only modification that [3 has order 3. Now G — C p x C3, and A < AGLi(p). 
So we are done once we show that the degree of the field of constants K(ip(N)) 
over K is > (p - l)/3, where N is the kernel of But [K(N) : K] = p - 1 
by Lemma [Tl§ and [K(ip(N)) : K] > [K{N) : K]/\/3\ by Lemma |644] , so the 
claim follows. □ 



Proo f of Theorem 6.25 . Combine the ideas of the proofs of Theorems 6.22 and 
3T2II. □ 



and 



Theorem 6.24. Let p be a prime with p = 1 (mod 4). Set K = Q(y— T) 
let E be an elliptic curve over K with complex multiplication by Ok ■ So there is 
an automorphism (3 of order 4. There exists an endomorphism $ of E of degree 
p. The associated rational function R : E/<(3> — > E / <(3> has ramification 
type (2, 4, 4), is defined over K , and has arithmetic monodromy group AGLi(p). 



Theorem 6.25. Letp be an odd prime, and E be an elliptic curve overQ with 
complex multiplication by the integers of Q(y/— 1). Let j3 be an automorphism 
of order 4. The rational function R : E/<f3> — > E/<[3> associated to the 
multiplication by p map has ramification type (2,4,4), is defined overQ, and its 
arithmetic monodromy group over Q is 

• (C p x C p ) x (C' p 2_ 1 xi C 2 ) if p = —1 (mod 4), or 

• (C p x Cp) x ((C p _i x Cp_i) xi C 2 ) ifp = 1 (mod 4). 

Proof of Theorems 6.24 an d 6. 2\ . The proofs are completely analogous to the 



proofs of the (2, 3, 6) cases. In order to prove Theorem 5.25 we need to know 
that \f—\ is in the field of constants. As previously, that follows from the 
branch cycle argument. Note that the branch points of the function R(X) are 
all rational by the proof of Lemma 3.15, even though the two points with inertia 
index 4 could a priori be algebraically conjugate. □ 



Example 6.26. Let w be a primitive 3rd root of unity, and K = Q(u>) = 
Q(V^3)- Let E be the elliptic curve Y 2 = X 3 + B with B G O k = Z[u]. Set 
p = 7. Clearly E fulfills the assumptions of Theorem |6.22 except possibly the 
one on good reduction at 7. The norm of 3 + ui is 7, so the endomorphism [3] + (3 
of E has degree 7. Using the addition formula, one can explicitly compute this 
endomorphism. It sends a point (x,y) € E to (*,R(y)) with 



R{Y) = 



(1 - lM(y 6 + (9 + 108w)By 4 + (459 + 216B 2 uj)B 2 y 2 - (405 + 324w)B 3 )y 

(7y 2 - (3 - 12lu)B) 3 ' 



The field of constants is generated by the roots of the denominator of R(Y). 
Thus the arithmetic monodromy group of R over K is AGLi(7), unless this 
denominator splits, in which case we obtain the index 2 subgroup of AGLi(7). 
This latter case happens whenever B = 5r 2 — 8rs — s 2 + (4r 2 + 2rs — 5s 2 )uj with 
r,s£Z. 
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Remark 6.27. We do not know whether the good reduction assumption is 
really needed in Theorem 3.23 . One can show that this assumption is superfluous 
if p = -1 (mod 3). Namely let E be the curve Y 2 = X 3 + B. Then the 
multiplication by p map sends (x,y) to (*, ^M), where V is essentially the 
p-division polynomial, expressed in terms of y. Assume that V is monic. We 
have V(Y) = h(Y 2 ), where h G Q[Y] has degree (p 2 - l)/6. Note that Y 2 is 
the Weber function on E, so Lemma |6.17 shows that h(Y) is irreducible over 
K = Q(ui). On the other hand, the proof of the theorem fails exactly if h(Y 2 ) 
becomes reducible over K. If that happens, then h(Y 2 ) = u(Y)u(— Y), where 
u G -^'[y]. Setting Y — shows that 1^(0) = h(0) is a square in K. On the other 
hand, the recursion formulae for division polynomials (see [ Lan78[ Chapter II], 
| Sil86 , Exercise 3.7]) allow to explicitly compute the constant term of V(Y): Is 
is ±3^ 2 - 1 ^ 4 B^P 2 ^/ 6 /p. Note that the exponents (p 2 ~ l)/6 and (p 2 - l)/4 
are even, so this coefficient is never a square in K. 

Unfortunately, this kind of reasoning does not seem to extend to the case 
p = 1 (mod 3). Here h(Y) is reducible and the absolute term of the factor which 
should stay irreducible upon replacing Y with Y 2 turns out to be a square if 
p= 1 (mod 12)! 



7 Sporadic cases of arithmetic exceptionality 



We are now going through the list of sporadic group theo retic can didat es for 
arithmetically exceptional functions suggested by Theorems 4.10 and 4.14 which 
do not belong to the series we dealt with, decide in each case whether they occur 
over some number field, and if they do, determine the minimal field of definition. 



7.1 G = C 2 xC 2 (Theorem [Og (a)(iii)) 

This is a very rich case, as every number field can be a field of definition, and 
also each C3 or 5*3 extension can be the field of constants. This is in big contrast 
to all the other cases. More precisely, we have the following. We thank Mike 
Zieve for an idea which helped constructing the function / below. 

Theorem 7.1. Let K be any field of characteristic 0, and E a Galois extension 
of K with group C3 or S3. Then there exists a rational function f(X) G K(X) of 
degree 4, such that the geometric monodromy group G is Ci x C2, the arithmetic 
monodromy group is A = A4 or S^, and E is the field of constants. 

Proof. Let Eg be a cubic extension of K inside E, and Z 3 + pZ + q E K[Z] be 
a minimal polynomial of a primitive element of Eq\K. Set 

= X i -2pX 2 -8gX+p 2 
J( >' A(X 3 +pX + q) ■ 

We claim that / has the required properties. Let A be a root of X 3 + pX + q. 
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Then one verifies that 

(X 2 - 2XX - 2A 2 - P f 



f{X) - A = 



A(X 3 +pX + q) 



This shows that the roots of X 3 + pX + q are branch points of /, of cycle type 
(2 2 ). Thus the geometric monodromy group of / is G2 x G2. Looking at the fiber 
/ _1 (oo) shows that the field of constants is the splitting field of X 3 + pX + q, 
thus E. □ 

The above theorem has an interesting consequence about compositions of 



arithmetically exceptional functions, see also Corollary 5.5 



Corollary 7.2. Let K be any number field. Then there are 4 arithmetically 
exceptional functions of degree 4 over K , such that their composition is not 
arithmetically exceptional. 

Proof. Let I be a Galois extension of K with group C3 x C3. (It is well known 
that over a number field any finite abelian group is a Galois group). For i — 
1,2,3,4 let Ei be the fixed fields of the 4 subgroups of order 3 in Gal(L|i^). 
For each extension Ei\K there is, by the previous theorem, an arithmetically 
exceptional function over K of degree 4 with Ei being the field of co nstants. To 
conclude the assertion, we only need to show (confer Theorem 2.10| ) that every 



rational prime p splits completely in at least one of the fields Ei. Let <p be 
a prime of L above p, and a € Gb1(L\K) be a generator of the corresponding 
decomposition group. Of course, a has either order 1 (and we are done), or lies 
in at least one of the groups Gal(L\Ei) . But then p splits in the corresponding 
extension EAK. □ 



7.2 G = (C?i) x GL 2 (3) (Theorem g7gjj(c)(i)) 



Let T = (ci, 02, 03) be a genus system of G, with the orders of o~i, 02, 03 
being 2, 3, and 8, respectively. Let Ci be the conjugacy class of*. One verifies 
that Ci and C2 are rational in G, whereas C3 = C| ^ C| = C\. Let ( be a 
primitive 8th root of unity. Suppose that we have a realization of these data 
over the number field K. 

Claim 7.3. Q(\/ = 2) = Q(( + ( 3 ) C K. 

Proof. Suppose not. Then K and Q(C + C 3 ) are linearly disjoint over Q, so there 
is an automorphism of Q|Q which is t rivial on K, but moves (3 :— C+C 3 to C 5 +C 7 - 



So the number m in Proposition 2.3 is congruent 5 or 7 modulo 8. However, A 



is the full automorphism group of G, but C3 ^ C™, a contradiction. □ 

Now set K :— Q(V~ 2). The above proof actually shows that TC :— (Ci,C2,Cs) 
is JsT-rational. One verifies that Ti is weakly rigid. Also, G contains only 1 con- 
jugacy class of subgroups of index 121 (for instance by the Schur-Zassenhaus 



Theorem), and 02 has a unique fixed point, so Proposition 2.8 applies. So 



there is a rational function f(X) £ K(X) with geometric monodromy group G. 
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The symmetric normalizer of G is A, with A/G — C5. Hence the arithmetic 
monodromy group of / is either G or A. We show that the latter holds. 

We start by assuming that the arithmetic monodromy group of / is G, and 
derive a contradiction. Let L be a splitting field of f(X) — t over K(t), hence 
G = Gal(L\K (t)) . There are subgroups V < M < G (unique up to conjugacy), 
such that the following holds: [G : M] — 12, [M : V] = 11, and T induces a 
genus system on G/V . Without loss assume that the branch points belonging 
to o 1 , cr 2 , and 03 are —27/256, 0, and 00. We now identify the genus fixed 
fields of M and V. First note that there is a subgroup W with M < W < G, 
[G : W] — 4, and the action of G on G/W is the symmetric group S4. The 
cycle types of the <jj are (1 2 2 1 ), (l 1 ^ 1 ), and (4 1 ), respectively. Thus, there is 
x E Lw, the fixed field of W, such that t = x 3 (x — 1). Then M is the stabilizer 
of K(x, y) for a conjugate y of x. Of course, also t — y 3 (y — 1). Note that 

r(r 3 - 1) 



r 4 - 1 
r 3 _ 1 



y 



1 - 1 

gives a parametrization of the non-diagonal part of the curve x 3 (x — 1) — y 3 (y - 
1) = 0. Also r — x/y so K(x,y) — K(r). We get 

r 3 (l - r)(r 3 - l) 3 



t = 

The linear fractional change 



(r 4 - l) 4 



yields 



1 (s 2 -6) 3 (.s 2 + 2) 3 _ 
t_ 1024 (s 2 -2) 4 ~ :9{S) - 



For later use we record 

27 _ 1 (s-2)0 + 2)[ S (s 2 -4g + 6)(s 2 +4s + 6)] 2 
+ 256 ~ 1024 (s 2 - 2) 4 • U 

Let Ly be the fixed field of V. The cycle types of the 0$ on G/M are (1 2 2 5 ), 
(3 4 ), and (4 3 ), whereas they are (1 12 2 60 ), (3 44 ), and (4 3 8 15 ) on G/V. From that 
we see that the branch points of Ly over Lm = K(s) are the 3 quadruple points 
in the fiber (7 -1 (oo), and one of the two simple points in the fiber <? _1 (— 27/256), 
and that the cycle types in each of these points is (1 1 2 5 ). Thus we get a ir- 
rational isogeny of degree 11 of an elliptic curve E\ defined over K to the elliptic 
curve E2 ■ Y 2 = (X ± 2)(X 2 — 2), see Section [| Upon possibly replacing s 
with — s (which does not change g(s)), we may assume that the elliptic curve in 
question is 

E 2 : Y 2 = (X -2)(X 2 -2). 
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Lemma 7.4. Let cf> : E\ — > E% be a K -rational isogeny of degree 11. Then E\ 
and Ei are K -isomorphic, and this isogeny is induced by complex multiplication 
with an integer in K . 

Proof. Let <fi '■ &2 —* E\ be the dual isogeny. We first show that there are 
at most two isogenics of degree 11, which are interchanged by the action of 
Gal(-K'IQ). Let i pu (X) be the 11th division polynomial. This can easily be 
computed using [ pon97 ] . First ip factors modulo 5 in irreducible factors of 



degree 10, so in particular no irreducible factor of ip over Q has degree < 10. 
Furthermore, —2 is a square modulo 17, and ip has two factors of degree 5 and 
the remaining of degree 10 modulo 17, so ip has at most two factors of degree 5 
over K, which are furthermore interchanged by Gal(if |Q). The assertion follows 
if we indeed exhibit an isogeny of degree 1 1 . First note that 

Pl (X ' F) ^ ( '2 X-2 >-— Y {X-2Y ] 

defines an endomorphism of degree 2 of Ei , which does not come from dividing 
by a point of order 2 (for instance because then this isogeny were defined over 
v2)- So if we identify E2 with the torus C/A with a lattice A in the usual 
way, then this endomorphism is induced by multiplication with \f—2. As |3 + 
a/ — 2| 2 = 11, we get that [3] + p is a Jf-rational endomorphism (where [3] 
denotes multiplication with 3) of degree 11 of E-i- The dual isogeny is the 
requested isogeny. (Using the addition formulae it would be possible to write 
out this degree 11 isogeny explicitly.) □ 

Using this and the factorization results from above, w e see t hat the associated 
map h(X) S K{X) on the A -coordinates (see Section |6.3.1 ) is arithmetically 



exceptional, with the field of constants a cyclic extension of degree 5 over K. 
Hence also the function / we started with has this field of constants, hence 
A > G. 



7.3 G = {CD x S 3 (Theorem jjj(c)(ii)) 



This case occurs over the rationals, see [|Mul99| 



7.4 G = {CD x {{C 4 x C7 2 ) x C 2 ) (Theorem g^4|(c)(iii)) 

Similarly as in case (i), we see that a minimal field of definition has to contain 
K := Q(V — 1)- Let T be a branch cycle description. Recall that the type is 
(2, 2, 2, 4). The involutions of course are rational, and the element of order 4 is 
-fT-rational. Furthermore, T is a weakly rigid tuple, and G contains only one 
conjugacy class of subgroups of index 25. Let 00 be a branch point corresponding 
to the element of order 4, and let pi,p2 5 p3 be the roots of a cubic polynomial 



which has Galois group S3 and splitting field K over K. Apply Proposition 2.8 
to this configuration to obtain /(X) £ K{X) with ramification data as above 
and geometric monodromy group G. (Note that the element of order 4 has a 



S3 



unique fixed point.) The branch cycle argument Proposition [2.3| shows that K 
is the field of constants of /, so the arithmetic monodromy group is A. 

Similarly, we realize the arithmetic monodromy group B. Let K be any cyclic 
cubic extension of K, pi be a primitive element of this extension, and p2, p3 the 
conjugates. Associate the three G-conjugacy classes Ci with the involutions in 
such a way, that the permutation of these classes by B is compatible with the 
permutation of the pi by Gal(K\K). Now apply Propositions and 2.2 to get 
the conclusion. 



7.5 G = (Cf ) x (Theorem g7g (c)(iv)) 



This is by far the most difficult case. In flylul99| we show that B/G = G 2 occurs 



(up to linear fractional transformations) two times over the rationals. There is 
strong evidence that A/G — C4 does also occur over the rationals. 

7.6 G = (CI) x D 8 (Theorem g7L|(c)(v)) 

Here we have the possible ramification types (2, 4, 6), (2, 2, 2, 6), (2, 2, 2, 4), and 
(2, 2, 2, 2, 2). The first two ramification types do not occur over any field K of 
characteristic 0. Namely the place with ramification index 6 must be rational, 
so the normalizer of the corresponding inertia group in A must not be contained 



in G by Lemma 2.5. However, the normalizer of a cyclic group of order 6 of G 



has order 12 and is a subgroup of G, a contradiction. 



The other two ramification types occur over the rationals, see [Miil99| 



7.7 G = (CI) x (C 5 x C 2 ) (Theorem [TTJ(c)(vi)) 

Suppose that this case occurs over some number field K. If B < A, then the field 
of constants K has Galois group A/G = S3 over K. Let K' be the quadratic 
extension of K in K. Then / E K(X) has, over K', arithmetic and geometric 
monodromy groups B and G respectively. So upon replacing K by K', we may 
assume that A = B. The ramification type of G is either (2, 4, 5) or (2, 2, 2, 4). 
Let / be the inertia group of order 4. One verifies that the normalizer in A of 
each cyclic subgroup of order 4 in G is contained in G. So Na(I) < G, contrary 



to Lemma 2.5. This shows that this case does not occur over any number field. 



7.8 G = PSL 2 (8) (Theorem |4JTj| (a)) 



Here A = PrL 2 (8), G = PSL 2 (8), and n = 28. There are three kinds of genus 
systems, namely of types (2, 2, 2, 3), (2, 3, 7), and (2, 3, 9), where the latter two 
come from coalescing branch points of the former type. We show that all cases 
indeed yield arithmetically exceptional functions over the rationals. 

Let (71,02, 03 be a generating triple of G, with cri<72<73 = 1, \<J\\ — 2, \a 2 \ = 
3, and | cr 3 1 = m with m = 7 or 9. Let Ci be the conjugacy class of 0$ in 
G. One immediately verifies that the triple H = (Ci,C2,Cs) is weakly rigid. 
Furthermore, the character values of the elements <r, lie in the real field K = 
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+ 1/Cm), which is a Galois extension of Q of degree 3. The classes C\ 
and C2 are rational in G and fixed under A = Aut(G) (simply because there is 
only one class of elements of order 2 or 3). Furthermore, A permutes the three 
conjugacy classes in G with elements of order m transitively. Associate a triple 
B of 3 rational points to the Thus the pair (B, Ti) is weakly Q-rational. Let 
H be a subgroup of G of index 28. Then H is determined up to conjugacy, 
because these subgroups are the normalizers of th e S ylow 3-subgroups of G. 



Also, o 2 has a unique fixed point. Use Proposition 2.£ to obtain /(A) £ 
with geometric monodromy group G. Let i be a transcendental, and L be a 
splitting field of f(X) - t over Q(t). We need to determine A := Gal(L|Q(t)). 
Let Q be the algebraic closure of Q in L. Then G&\(L\Q(t)) — G. We cannot 
have Q = Q, for then A — G, but C3 is not rational in A, contrary to Corollary 



2.4. Thus A properly contains G, but also acts on the 28 roots of /(A) — t and 
normalizes G. So A must be PFL2(8). 

We now construct an example with ramification type (2, 2, 2, 3). For this let 
/ be as above of type (2, 3, 9). After making suitable choices of the necessarily 
rational branch points and some of the necessarily rational preimages, we may 
assume that 

X -a{Xf 



f(X) = 



b{Xf 



with polynomials a, b £ Q[X}. So /(A 3 ) = g(X) 3 for g(X) £ Q(A) of degree 
28. One easily verifies that g has ramification type (2,2,2,3). We show that 
g has the same pair of arithmetic and geometric monodromy group as /. We 
give the argument only for the arithmetic monodromy group, a slight variation 
handles the geometric group too. 

Let t be a transcendental, x a root of /(A 3 ) — t, L a Galois closure of 
Q{x)\Q(t) with group H = Gal(£|Q(t)). Set U f := Gal(L|Q(x 3 )), M := 
Gal(-%(a:)), U g := Gal(£|Q(ir)), N f := core H ([/ / ), and N g := coTe H (U g ). 
So the arithmetic monodromy group of / and g is H/Nf — PrL2(8) and M/N g , 
respectively. 

We first claim that H = MN f . Suppose false. Then Nf < Uf n M = U g , 
but the core of U g in H is trivial, so Nf = 1. So H — PrL2(8) has a non-normal 
subgroup M of index 3 (note that M < U corresponds to the non-normal cubic 
field extension Q(g(x))\Q(g(x) 3 )), a contradiction. 

From H = MN f and Nf < Uf we obtain 



N g = n up 

mEM 

= f](u f n M) m 
= ( p| uj 1 ) n m 

meM 

= ( p| u*}) n M 



85 



= N f n m, 



so the claim follows from 

H/Nf = MNf/Nf = M/(N f n M) = M/N g . 



7.9 G = PSL 2 (9) (Theorem |Og (b)) 



Here Mi < A < PrL 2 (9), G = PSL 2 (9), and n = 45. The genus systems of 
G are of type (2,4,5). They are weakly rigid. Let C\ and C 2 be the conjugacy 
classes of elements of order 2 and 4, and C3 and C3 be the two conjugacy classes 
of elements of order 5. 

Now let (cti, 02, 03) be a generating triple of G with <7j G C*. The classes Ci 
and C 2 are rational in G and fixed under M10 < Aut(G), whereas M10 switches 
C3 and C3. Therefore (Ci,C 2 ,Cs) is weakly Q-rational. The group G has only 
one conjugacy class of subgroups H of index 45, as these subgroups are the 
Sylow 2-subgroups of G. As er 2 has a unique fixed point we can apply Proposi- 



tion 2.8 to obtain f{X) £ Q(X) with geometric monodromy group G and given 
ramification. Let t be a transcendental, and I be a splitting field of f(X) — t 
over Q(t). As in the previous case, we need to determine the arithmetic mon- 
odromy group A = Gal(L\Q(t)). The group G in its given action is normalized 
by PLL 2 (9). First note that Corollary |2.4| shows that A is not contained in 
PGL 2 (9), for A must switch the conjugacy classes C3 and C 3 . Suppose that / 
is not arithmetically exceptional. Then A = PEL 2 (9). So A acts imprimitively, 
moving 15 blocks of size 3. Thus we have f(X) = a(b(X)) with a(X) £ Q(X) 
of degree 15. Therefore a has geometric monodromy group Aq = PSL 2 (9). But 
the (2,4,5) system also has genus with respect to the natural action of Aq. 
Let H be a point stabilizer in A§ of this action, and J the normalizer of H in 
the arithmetic monodromy group (which is Aq or Sq) of a. Then the fixed field 
of J gives a rational function h(X) £ Q(X) of degree 6 and ramification type 
(2, 4, 5). Suppose that 00 and correspond to the inertia generators of order 5 
and 4 respectively. Without loss let the single point in /i _1 (oo) be 0, and the 
quintuple point be 00. Furthermore, assume that the quadruple point in /i _1 (0) 
is 1, and the other one is a £ Q. So 

*(*) = £- im - a)a 



X 

The third branch point of h has to be rational, and is the root 7^ of the 
discriminant with respect to X of the numerator of h(X ) — t. Dividing by i 4 we 
get 3125t 2 + (-256 + 15060a + 33360a 2 - 2120a 3 + 720a 4 - 108a 5 )t - 1024a + 
6144a 2 - 15360a 3 + 20480a 4 - 15360a 5 + 6144a 6 - 1024a 7 . So this polynomial 
has only one root, therefore its discriminant 16(a 2 — 11a + 64) 2 (9a 2 + 26a + l) 3 
vanishes. However, this polynomial does not have a rational solution a. This 
contradiction proves that M 10 < A. 
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7.10 A remark about one of the sporadic cases 



The degree 28 case in Theorem 1.4, which corresponds to a (2, 3, 7) generating 
system of G = PSL 2 (8) is somehow classically known. Note that A = PrL 2 (8) 
contains a subgroup U of index 9 with A — UG, such that the (2, 3, 7) system 
induces genus on A/U. (The induced genera are > for the two other genus 
systems though.) Thus there should be a rational function f(X) G Q{X) of 
degree 9 and {A, G) as arithmetic and geometric monodromy group. Such a 
function has been computed frequently in the past by Goursat, J-F. Mestre, 
and others, see [Ser94|. In [3er94|, Serre sketches a computation of /. Noting 
that the coefficients of / happen to lie in Q, he asks "Could this be proved a 
priori? I suspect it could." Proposition 2.8, and the way we proved existence 
without computation, gives an affirmative answer. Later on Serre speculates 
about a "modular" interpretation of this case and a connection to Shimura 
curves. A recent preprint [Elk98] by Elkies contains a lot of material in this 
regard. A similar interpretation holds for the degree 45 case (Elkies, personal 
communication) . 

It would be interesting to find nice interpretations for the other sporadic 
cases too. 
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